AI Data Privacy: Local Solutions for Sensitive Data
How to use AI safely with sensitive data: local models, hardware tiers from laptops to DGX Spark, and redaction techniques that eliminate exposure risk while delivering real results.
The concern I hear most often
"But what about the safety of my data? I can't upload anything sensitive there, it will all get leaked!"
This is probably the concern I hear most often when talking about AI adoption.
And yes, data privacy and security is always a concern. If we don't want to trust technology, we can always go back to doing accounting with pen and paper. But we learned to trust computers, Excel, cloud storage, online banking and a bunch of other technologies. We just need to learn how to use AI safely.
Option 1: Keep everything local
There are several ways to do this. For maximum privacy, keep everything local. Get a computer that can run a local model. How powerful it needs to be depends on your needs.
- Just writing? Almost any computer will do.
- Want to run mid-sized models? Most gaming computers will do.
- Want something larger? Get a DGX Spark, AMD AI Max system, Mac Studio or similar.
- Want enterprise-level AI? Go buy an H100 and let me know how much that costs.
Most likely you will end up somewhere in the middle where a dedicated GPU or Spark is more than enough for your needs. Your data stays on your machine. No OpenAI, Google or foreign company sees it. You decide what model you run and where it runs.
Option 2: Redact your data
But let us say you do not want to invest in hardware. That is perfectly fine too. You can simply redact your data.
Just as you do not store your passwords in a blank Word document called "Passwords" (at least I hope you do not), you should not blindly upload sensitive information to AI either.
- Change client names.
- Change dates.
- Change amounts.
- Replace confidential information with placeholders.
- Give it a fake database that matches the structure of your real one so it can build the code, dashboards, reports or applications you need.
Want to create a forecasting model or machine learning application? You do not need to feed it your real data. Just explain how your data is structured, what the columns look like, and what you are trying to predict. It can build the Python code, the dashboards and the models using fake data. Then you run it locally against your real database, just as you use your data on Excel.
Real world results
I have done exactly that. 90%+ forecasting accuracy and essentially zero risk of exposing sensitive information.
The reality is AI is no different than any other tool. If a random person on the internet asked for your passwords, SSN, banking information or confidential company data, you would not give it to them. Do not do it with AI either.
What this means in practice
- Use common sense.
- Adapt to your industry requirements.
- Experiment with what level of privacy you need.
- Start learning now, not later.
Getting started
Need help getting started? Hit me up at www.felipepostigo.com.
FAQ
How do I run AI locally?
You can run local models using tools like Ollama, llama.cpp, or vLLM. The hardware required depends on model size: consumer GPUs handle mid-sized models, while larger models need workstation-class hardware like DGX Spark or Mac Studio.
What is the safest way to use AI with sensitive data?
The safest approach is running a local model on your own hardware with no internet connectivity required. If that is not feasible, redact all sensitive fields and use synthetic data that mirrors the structure of your real data.
Do I need expensive hardware for local AI?
Not necessarily. For text generation and writing tasks, almost any modern computer works. For larger models, a dedicated GPU (gaming computer level) is sufficient for most professional use cases.
What data should I never upload to AI?
Never upload passwords, SSNs, banking information, trade secrets, confidential company data, healthcare records, or anything you would not post publicly. When in doubt, redact or use local.