Private AI

Use AI without giving every workflow to a third party.

Private AI is an operating choice, not a product category. It comes down to three questions: where does the model run, what leaves the device, and who sets the policy. Glyph answers all three with a local-first desktop and mobile workspace that keeps the destination of every request visible and selectable.

Download Glyph

Reviewed 2026-09-13 against the current Glyph release and deployment documentation.

What “private AI” actually means

Most AI products are private in the marketing sense: a vendor promises to handle your data well. Private AI in the operating sense is different. It means you can point at each step of a workflow and say where it executed and what it transmitted. A chat window that sends every prompt to a hosted model, a “private” tenant on someone else’s cloud, and a model running on the laptop in front of you are three different boundaries, even if the interface looks the same.

The useful mental model is destinations. Every feature either keeps data on the device, sends it to infrastructure you operate, or sends it to a third party under that party’s terms. A private setup is one where the default destination is the device, exceptions are deliberate, and policy can enforce those exceptions for a team.

Where data goes in a typical AI workflow

The chat window is only the visible part. A single question can touch model inference, document retrieval, embeddings, web search, a connector, crash reporting, and account sync. The table lists each hop and what Glyph does with it by default.

Data hops in Glyph desktop 1.3.0 and their default destination
HopDefault in GlyphWhat changes it
Model inferenceOn-device via the bundled llama.cpp or MLX runtime with the local model you selectedSelecting a cloud provider model (your API key) or a Glyph Private server
Document parsing and embeddingsLocal; the knowledge base embeds with a bundled sentence-transformer model and stores a FAISS index on diskA self-hosted deployment can use a shared, server-side knowledge base
Memories and personasMarkdown files under .glyph/memories and local settingsOptional account sync for mobile and desktop
Web search and browsingOff; a request only reaches a search provider when you enable web access for that turnEnabling web access or the embedded agent browser
Connectors (MCP, skills, tools)Off until you install and approve a connector; each one talks to its own serviceInstalling a connector such as Gmail or a database
Crash and error reportingScrubbed crash reports, gated by a telemetry setting you can turn offDisabling telemetry; enterprise deployments can point reporting at their own project
Account and subscriptionFortaify receives account, subscription, and reliability data only — never chat or document contentNothing; local-model chats are never uploaded to Fortaify

How Glyph keeps the boundary visible

The model picker is the control. Local models are labelled as local and run through the runtime that ships with the app — Metal on Apple silicon, CUDA, Vulkan, or CPU on Windows and Linux. Cloud models appear only after you add your own provider key, which is stored in the operating system keychain, and every response from a cloud model is attributed to that provider so a user cannot mistake a hosted answer for a local one.

Features that must leave the device say so at the point of use. Web search, the embedded browser, GlyphNet device pairing, and connectors are each enabled deliberately. That is slower to set up than a product that silently does everything in the cloud, and it is the point: the default is on-device, and every exception is a decision someone made.

The same design carries to mobile. Glyph for iPhone and Android runs phone-sized GGUF models on the device and, when you pair it with your desktop over GlyphNet, sends prompts to your own computer rather than to a hosted model.

Private AI for one person versus a team

An individual can download Glyph, pick a model that fits the machine, and have a private workflow in an afternoon. The remaining risks are ordinary device risks: full-disk encryption, backups, and not pasting secrets into a cloud model by accident.

A team has a different problem. Ten people with ten laptops will make ten different choices about cloud models, connectors, and where documents live. Private AI for a team therefore needs policy: which model destinations are allowed, who can enable web access, how a departing employee’s access is revoked, and what evidence exists afterwards. Glyph Private moves those decisions to a server the organisation operates — identity through OIDC, per-user model catalogues, a gateway that routes and records requests, and signed policy delivered to enrolled desktops. Availability of individual enterprise controls varies by release, so scope a pilot around the controls you need and verify them before rollout. See private AI for business for a pilot plan.

What private AI does not solve on its own

Running a model locally removes one class of risk — disclosure to a model vendor — and leaves others untouched. Be explicit about them when you evaluate any tool, Glyph included.

  • Access control still matters. A local index of confidential documents on an unlocked laptop is no more private than the laptop.
  • Prompt injection does not care where the model runs. Connectors and browsing extend what an agent can touch; approve them narrowly.
  • Model quality is a separate axis. A small local model can be private and still wrong; test it on your own tasks before relying on it.
  • Backups and recovery are yours. Local data that exists only on one drive is private and also fragile.
  • Compliance is a process, not a checkbox. Fortaify does not claim certifications for Glyph; the Trust Center states what is implemented and what is planned.

Getting started

Install Glyph and verify the installer checksum from the download page. Choose a model sized for your memory — the local LLM guide explains how. Turn on the features you need one at a time, reading what each one sends and where. If you are evaluating for an organisation, start with the readiness checklist and talk to sales about a scoped pilot.

Frequently asked questions

Is Glyph fully offline?

Local inference, the knowledge base, image generation, and voice tools run without a connection once the models are on the device. Model downloads, cloud providers, web search, connectors, software updates, and account sync need connectivity and are separate, visible choices. See the offline AI page for the exact feature list.

Does Fortaify ever see my chats or documents?

No. Local-model chats, documents, indexes, and generated content stay on your device. Fortaify receives account, subscription, and scrubbed crash-report data, and crash reporting can be disabled.

Can I still use cloud models when I want to?

Yes. Add your own API key for a supported provider and that provider’s models appear in the picker, clearly labelled. Requests to them are governed by that provider’s terms, not by the local boundary.

Is a local model as capable as a hosted frontier model?

Usually not on the hardest tasks, and often good enough on everyday ones. The practical answer is to test representative prompts on your hardware; the local versus cloud comparison explains how to run that evaluation.