> At the same time, the press service states that some of the staff will continue to have access to a special platform for AI assistants, which the Government Offices themselves developed, and through which they gain access to ChatGPT and Claude.
Sounds like they just want to maintain control over the outbound traffic which sounds rather sensible to me.
lucumo 2 hours ago [-]
> Sounds like they just want to maintain control over the outbound traffic which sounds rather sensible to me.
Yeah, and probably also forcing Zero Data Retention contracts on those service, instead of the consumer variants.
theplumber 2 hours ago [-]
The contracts are really worthless if for example Trump wants to share the transcripts with Putin. At this point I don’t understand why governments would outsource any of their data services to 3rd parties (I.e outside of the EU). EU should establish an EU gov cloud program and just run the models themselves for all the EU countries(under license of course). They would probably get better bargaining power as well.
abm53 2 minutes ago [-]
You’ve leapt to the most extreme scenario to declare these contracts worthless.
Of course something like what you describe could happen. But under the central case, ensuring some privacy (with the ability to seek damages if breached) whilst still providing access to frontier models seems like a reasonable trade-off with a lot of value.
petcat 2 hours ago [-]
Such a thing would require building data centers, i.e. industrial compute factories, but the EU is politically paralyzed from doing that because electricity is already outrageously expensive and there is just sort of a general popular outrage about the prospect of it.
Frieren 1 hours ago [-]
> the EU is politically paralyzed from doing that because electricity is already outrageously expensive and there is just sort of a general popular outrage about the prospect of it.
That is called democracy. Where the good of citizens is valued above what big corporations want. To push up pollution and power prices so big American tech companies can play with AI seems something that only a mad king would do.
philipallstar 18 minutes ago [-]
It's not democracy. People don't want high energy prices. It's just their only voting options are all politicians who will give them high energy prices.
Big corporations are only big because they provide what customers want. They don't get to extract money from people's work, the way politicians can.
xvector 1 hours ago [-]
Citizens are dumb though, the stupidity of the public killed nuclear. Not every decision needs to be democratic. Certainly not core infrastructure decisions.
It's also so easy to astroturf to manipulate public opinion. If I were China, I'd post so much anti-datacenter content everywhere in the West to gain a leg up in the race to superintelligence, because we are dumb enough to let our citizenry influence these decisions.
Imagine if we did the same thing for the nuclear race. ASI is winner-take-all, the first one to ASI can just lock everyone else out.
11 minutes ago [-]
ruaraidh 34 minutes ago [-]
How definitive. I wish I had your certainty about literally anything.
interactivecode 32 minutes ago [-]
If I was a American oligarch who became president due to my ties to social media platforms and influence I would also advocate european governments use American AI services.
myrmidon 10 minutes ago [-]
How is electricity outrageously expensive? We get power in the most flexible of forms (electrical) delivered directly to our homes at a rate that no human in history would have ever performed voluntary physical labor for (the equivalent of thousands of horses or people for a few hundred bucks an hour, assuming <500$/MWh). Even complete energy autarky has become feasible for private individuals if you are willing to invest.
Just because power used to be even cheaper in the recent past, by doing non-sustainable shit and pushing all the resulting costs onto others/the future does not mean that was ever appropriate, necessary or desirable, and everyone advocating for chasing that model is a greedy, selfish asshole in my view.
data center being in EU matters little when it is owned by US company that US govt can just tell "gimme that data"
consumer451 1 hours ago [-]
Sure, even in colocation cases, Google LLC owns all the data, but we certainly do have DCs in the EU.
Now, do we have DCs with "temporary gas generators" operating 24/7 that were thrown together in the last 2 years? Probably not.
1 hours ago [-]
roosterIllusi0n 59 minutes ago [-]
AI is local. They need to invest in procuring hardware, which means making it themselves if that is the only way to get a card in every computer that can do the job.
If cloud based AI is any good, they will sell versions that can be hosted locally just like every other service since the beginning of the internet.
erwald 3 hours ago [-]
The internal service is Microsoft Copilot, so this is probably just a really really dumb decision.
toss1 44 minutes ago [-]
Yes, my first thought on reading the headline was: "the result will be they'll just ensure everyone uses some worse AI models".
So only mildly surprised on reading the article to read they are intentionally forcing them onto a specific worse model.
laurentiurad 3 hours ago [-]
No, they use OpenAI with deployment in the Swedish data centers, which keeps inference local. Azure and GCP already offers this. No idea about Claude though.
soco 2 hours ago [-]
Maybe it's what you meant, but let me underline that "local" does NOT mean under your control. As long it's with Microsoft, it will fall under the exactly same Cloud Act, so it can be shut off or copied over the pond on a whim.
laurentiurad 2 hours ago [-]
You're right in theory, but it doesn't mean the US gov has unrestricted access to the data. There needs to be a legal process in place and there are safeguards that prevent accessing the data without that. This will happen to any company within US jurisdiction, as authorities can compel any provider to give them the required data.
You say that but that's not reflected in the law, and historically the us government has repeatedly created such sweeping surveillance systems. It's highly unlikely they only made it legal, and aren't using it sweepingly considering theyre on record doing so before it was legalized through the act before too...
And as that's international law... It's always kinda a coin toss whenever anyone actually pays it any attention. No real recourse if violated after all.
Lagoon3384_SWE 2 hours ago [-]
[dead]
Lagoon3384_SWE 2 hours ago [-]
[dead]
trilogic 10 minutes ago [-]
The rise of HugstonOne.
adelekeabdulgan 3 hours ago [-]
why then are they using Microsoft Copilot?
przmk 3 hours ago [-]
Probably for the same reason as in most companies: Microsoft “assured” them that their data is safe… who cares about the Cloud Act, right?
mr_mitm 3 hours ago [-]
Or: Microsoft has the data already, so why give the data to Anthropic and OpenAI, too?
kevin_thibedeau 2 hours ago [-]
Microsoft will helpfully house that data in China. The others won't.
igl 2 hours ago [-]
AWS and GCP also use local Chinese joint-venture partners to comply with Chinese regulations. Warm greetings to Moscow!
tonyhart7 2 hours ago [-]
I rather trust MS than OpenAI or Antrophic
MS don't train your data
InsidiousWombat 2 hours ago [-]
MS barely trains on their own data given how shit copilot is even when dealing with MS stuff
andruschakartem 2 hours ago [-]
[dead]
3 hours ago [-]
nalekberov 3 hours ago [-]
I second this.
2 hours ago [-]
Roark66 2 hours ago [-]
Same reason why the Fortune 200 company I'm currently doing some work for uses it. 70% discount on api costs compared with Anthropic, but access to the same Anthropic models.
Here every person gets $500 of copilot "credits" per month and that is a lot of use. $500 in Anthropic API gets used in 3 days.
The only disadvantage is that copilot cli has a very crappy and limited plugin system. For example a plugin can register a hook when a model calls a tool, but it's impossible to show a question to a user from such plugin.
Also it's "Autopilot" mode is designed to waste tokens. It injects things like "did you do absolutely everything you can about this? If not continue" and it's impossible to disable this without reverse engineering.
adelekeabdulgan 2 hours ago [-]
I dont think opting for copilot on a cost basis fit into "ban".
3 hours ago [-]
refactor_master 2 hours ago [-]
Because nobody was ever fired from choosing Microsoft, and apparently this still holds for AI?
sandworm101 3 hours ago [-]
It is part of the trend to locally-hosted AI. I demoed my home rig (3x5060s) to my boss last week. It certainly was not as performant as commercial options, but was well above the 90% solution for what we needed. The boss was shocked at the price points for home-built hardware. Gaming GPUs are pricy, but are nowhere near the prices for commercial (rack-mount) compute hardware.
(People actually came by my desk to see "the AI", the physical thing. It blows people's minds to realize AI doesn't need a data center, that it is just some computer parts sitting on a desk.)
The big hitter AI companies see the writing on the wall: open source models and local AI rigs will decimate the market for big AI in the next few years.
snarf21 2 hours ago [-]
I see this as the eventually end game. Open source models and local hardware are going to be the only path forward for companies as the AI providers move to a constant need to increase prices to drive profitability and stock price.
nradov 2 hours ago [-]
There's no particular benefit to keeping the hardware local unless you have extraordinary security requirements. Over time most of the workloads will end up in data centers with the cheapest electricity and real estate.
WarmWash 2 hours ago [-]
Just like on-prem killed cloud?
sebzim4500 3 hours ago [-]
It's not locally hosted, as they say they will be accessing the same models but through a controlled system rather than on their own accounts
wafflemaker 2 hours ago [-]
Can you post a picture? It sounds super cool. Was it a specialized hardware, or a consumer mobo with 3 PCIe slots?
sandworm101 2 hours ago [-]
It is just a Asrock motherboard and 1000w corsair power supply sitting on the bottom shelf of a "mining rack" open air case. The GPUs are attached with janky pci risers (the motherboard has four pci slots). I went with 5060s so I could stay with "short" 2-fan cards. The boot drive is a 500GB NVME with an encrypted 2tb NVME for storage, both on the mobo. I added four cheap fans and an oldschool (with a nob) fan controller to circulate air away from the GPUs. RAM options are maxed out at 4x16GB DDR4 sticks. Expansion options include adding a fourth 5060 and any number of SATA storage drives for content/models.
It, of course, runs on linux. I went with stock ubuntu so I could attach a screen and/or remote in to a full GUI. Having a full GUI also makes the rig more relatable to people who's eye glaze over when they see a terminal interface. "It's just a funny-looking desktop computer."
At 48GB of VRAM it can run basically any LLM I would want to download. Speeds are fine for a single user (Tok/s numbers change based on model/mode). But if I were using it for something like ComyfUI I would ditch the multiple 5060s and go with a 5070ti or 5080 as ComfyUI does better with a single powerful GPU.
rmnwski 3 hours ago [-]
Interesting! How many token/s using what model are you getting out of it? And what are the other specs?
vocram 3 hours ago [-]
Cool, but that sounds out of reach financially and technically for most people
flir 3 hours ago [-]
I don't think it will be the moment nvidia decide there's more money to be made in selling hardware for local-first inference. They'll do the training themselves and give the models away for free, like the toy in a box of cornflakes.
I'm sure cloud models will always have a slight edge but most tasks, most of the time, won't need that few extra percentage points of performance.
antihipocrat 2 hours ago [-]
In a lot of sci-fi games an upgrade path for ship/cybernetic hardware is to replace the 'AI chip'. If the models performance ever start to plateau I can't wait to see AI models being baked into the chip itself.
sandworm101 3 hours ago [-]
>> out of reach financially and technically for most people
Yes and no. I bought most of the hardware before the rampocalypse. It is just an AM4 chip on a nothing motherboard. Even today, 16GB 5060s are maybe 500 each. 64GB of DDR4 is another 500$. Add a power supply and pci risers and the basic parts could be purchased today for around 3000$... call it 4000$ all-in including my labor to get everything connected and talking to each other.
4000$ is money but is also almost nothing in the world of commercial IT purchases.
logicchains 3 hours ago [-]
The article is about the Swedish Government, hopefully it wouldn't be out of reach for them.
nayroclade 3 hours ago [-]
They're using Copilot, not locally-hosted AI.
mjr00 3 hours ago [-]
What a complete nonstory. Even at my 50 person startup we have an IT policy that requires employees to only use approved AI tools. For a government the only real news is that there wasn't already something in place enforcing this.
techjamie 2 hours ago [-]
Same at my work. We have access to our own LLM tools that are backed by OAI/Claude depending on user pref, but with data retention/training contracts in place so they don't keep/train on our internal data.
giamma 2 hours ago [-]
I believe the problem is related to staff using free plans of Claude and ChatGPT.
I don't know for ChatGPT but Claude claims that it will keep your chat private and not use your data for training if you are on a paid plan [1], unless you decide otherwise: "By default, we will not use your inputs or outputs from our commercial products (e.g. Claude for Work, Anthropic API, Claude Gov, etc.) to train our models."
The same statement is missing from the free plan policy page [2]
So it's totally reasonable for a Government to block its staff from using free services as this may leak sensitive information. We are doing the same in my organization hoping to protect our intellectual property.
Glad to know Swedish gov woke up. 6 moths ago they didn´t understood what are the cloud and external data collection. But the recent HugstonOne presentation went to the right people. Heya Sverige.
a_humean 2 hours ago [-]
Seems like a non-story. It sounds like a ban on people using personal accounts with unsanctioned services and sending government data to them. Even most small companies might have restrictions like this.
This is just an IT org asserting control over how data moves in and out of the business/government. Its seems pretty reasonable that a company/government would want a contract in place with any provider they are sending data to. Oblivious that is going to have costs in agility and picking the best tools, but this is reasonable information security behaviour.
I'm surprised they aren't taking the extra step and moving to restrict data sharing to only EU based firms given... geopolitics.
dhruvagoyal 55 minutes ago [-]
> The use of AI services without a contract can have "consequences for our information security"
Totally logical and smart take. Any govt (or for that matter, anyone) not doing this is just giving all their data to these providers for free.
jttnr 3 hours ago [-]
At first I was like: Nice, they ban AI because its all US based vendors and using them for government related data is not a good idea.
But then the story goes on and say MS Copilot is an approved AI... Sad thing to read.
f6v 2 hours ago [-]
Their second choice was using a hosted GLM-5.3 and calling it a “sovereign AI”.
samus 3 hours ago [-]
It's not ideal, but governments already use MS products on a large scale. Quite some are cloud-based these days. And they are an established corpo that is doing well financially compared to pure model operator that might be broken up the day after tomorrow for spare parts by their investors and creditors, which put the confidentiality of the conversation logs into jeopardy.
teiferer 3 hours ago [-]
On the one hand, it makes sense to focus on few whitelisted providers with whom there are explicit confidentiality agreements.
On the other hand, the simplest explanation is that the Microsoft grip on those government agencies is strong and with them already exclusively using the Microsoft ecosystem like all swedish public employers are (including universities), it's only the natural next step to strongarm them into using exclusively their AI offering as well.
einarfd 1 hours ago [-]
Makes sense, you don't want civil servants sharing sensitive data with none vetted servicess.
I do feel for the civil servants that have to use Copilot though, it was a breath of fresh air to move to Claude Code when I did, and if Copilot is half as bad as the Google Gemini document integration, which loves to give you variants of "I can not do that". I get why they don't want to use it.
all3z 2 hours ago [-]
Important note; “Government Offices of Sweden” or Regeringskansliet as it is named in Swedish is one specific agency. It does not imply, as the title might suggest, that the rule applies to all offices and agencies under the Swedish government.
SoKamil 3 hours ago [-]
TL;TR they want people to use Copilot
sorenjan 3 hours ago [-]
This seems to be because of sensitive data and auditing, not just contacts.
> The risks of unregulated AI use have been noted within a number of authorities where there has also been reason to take other measures.
> Among them is the Swedish Transport Administration, where the internal audit earlier this year discovered widespread and risky use of about ten different AI services and wrote as follows:
> "We have seen several examples of problematic use of open AI services. The examples concern both the sensitivity of the information entered and how the AI-generated responses have been handled."
> Some staff will continue to have access to a dedicated platform for AI assistants—developed in-house by the Government Offices—which provides access to ChatGPT and Claude.
> Internal information also indicates that, following a review, security measures for the approved tool Copilot have been strengthened. However, the press office has declined to provide details regarding these enhancements, citing security considerations.
Meneth 1 hours ago [-]
Seems like it's all about Copilot's increased security, but they refuse to talk about what that means. How is security increased? From what level, to what level? Does anyone know? ... A quick Bing search later, this M$ article is at least a starting point:
I think some good background for this is also that Skatteverket ("Swedish IRS") has made headlines recently for allowing wide usage of Azure within its IT-infrastructure. Seemingly with very little investigation into the abysmal privacy/integrity/confidentiality posture of US-based cloud services.
I would suspect those headlines caused public officials to investigate how the public sector employees actually use AI chatbots.
I can't fathom why they would willingly try to migrate such critical operations away from a secure state-run system. I'm sure that system sucks in some ways. But those issues can be worked on, surely.
petcat 3 hours ago [-]
It appears they are only allowing Microsoft Copilot. So it seems like possibly this is contractual with their Microsoft office/windows licenses.
jttnr 3 hours ago [-]
That is likely the case. Microsoft is shoving Copilot down everyones throat, whether they want it or not. The sales argument is always: "Why pay for another license if it's already included in O365?" Plus the fact that some data protection contract is already negotiated to be able to use O365 for email.
In the end, if employees are dissatisfied with Copilot, blocking Anthropic and OpenAI will just make people switch to their personal devices and use those services on their smartphones if necessary.
redleader55 3 hours ago [-]
You are forgetting something very important. Microsoft has a much better track record of data policies being correctly enforced. Neither OpenAi or Anthropic have that.
It's not about the model or who gets the bribe, like a few folks in this thread imply, it's simply the guarantees that Microsoft is able to give to a public institution about what happens to their data.
CharlieDigital 3 hours ago [-]
> Microsoft is shoving Copilot down everyones throat
Of the three, I would rank Microsoft as less risky with data handling. Even if the other two are better products, I can see how data control is an important consideration in government. Of course, best is if they operate a fully controlled platform; that may yet be their endpoint.
edukite 2 hours ago [-]
That's why they backpedal on screenshoting entire screen, keeping images on device and feeding them to LLM? Yeah, for me all of them have 0% trust. Malware used to need to be installed, not part of OS
CharlieDigital 2 hours ago [-]
That's not how trust works in this context; the trust is in the handling of that data. It should be a given that if you're using a government machine, it's going to be under strict controls in the first place.
jttnr 16 minutes ago [-]
I would argue that there are two distinct kinds of trust here:
- Legal trust: Lawyers draft hundreds of pages specifying what may and may not be done with the data.
- Evidence-based trust: Looking at Microsofts actual track record, past privacy incidents, regulatory findings, and whether its data-handling practices have matched its disclosures and contractual commitments.
Just a reminder: Last year, the email address of the prosecutor of the International Criminal Court (ICC) was suspended. Karim Khan couldn’t access his Microsoft account and had to move to Proton Mail.
mschuster91 3 hours ago [-]
> Plus the fact that some data protection contract is already negotiated to be able to use O365 for email.
This is most likely the key thing. At least here in Europe, already having the processor agreements set up - and Microsoft actually at least trying to do the bare minimum regarding compliance - is worth a lot, even for a nominally inferior product.
mrweasel 2 hours ago [-]
One argument could be that they want to provide an AI solution, but maintain some level of control. Copilot can be bundled in with existing licenses, so it's a easier purchase in some sense.
Across the bridge, in Denmark, we've already seen a number of cases where government employees have use various AIs to help them do their job (and in many case used an AI to fail at doing their job). The result has been information about citizens just being entered into whatever AI the employee fancied, without worry about leaking private and sensitive information. I'm not entirely convinced that the public employees strictly speaking needs an AI, but if they are going to use one regardless, it makes sense that it's one that has been approved, whatever that might mean.
Seems like a good way to govern usage to an alternate model provider
READ_A_BOOK 3 hours ago [-]
[dead]
bittermandel 3 hours ago [-]
This seems to only be for a few of the offices as well. A famous project (at least in Swedish news) earlier this year introduced airgapped Kimi-based models for usage, but it got paused.
yxhuvud 2 hours ago [-]
How is it news that they have preferred tools that they enforce the usage of? Any decently competent IT org should do the same.
digitaltrees 3 hours ago [-]
History will spend a lot of time exploring how the two front runners of AI mismanaged their rep and eroded public trust so severely that people rejected their transformative technology.
Razengan 3 hours ago [-]
History should spend some time looking at all the prediction-of-doom comments about shit that went on to conquer the world.
Bit dramatic headline. Every it department or whomever governs data on earth doing it's job is at least thinking of how the organization uses ai. What data it is fed, cost, what actions it can take.
Limiting the amount of tools sounds like a sane default in most cases.
Nothing in this necessarily say anything about one of the tools doing a better job than the other in this regard. It might say a little bit about trust though, warranted or not.
luis_valerio 59 minutes ago [-]
Best way to officially support shadow AI at government, sounds great idea
3 hours ago [-]
CerebralCerb 2 hours ago [-]
There should be a bonus for the sales guy at MS who managed to manipulate some midwit government employee into introducing government regulation to give them a monopoly.
adelekeabdulgan 3 hours ago [-]
A deal was signed behind closed doors.
3 hours ago [-]
paaloeye 2 hours ago [-]
Makes sense. MSFT is massive in the Nordics. Good luck OpenAI and Anthrop\c!
tjpnz 10 minutes ago [-]
Meh? Most orgs Beyond a certain size maintain a list of which vendors are acceptable.
roosterIllusi0n 1 hours ago [-]
Any university that has not banned these while offering local hosted models is stealing from you. The last thing a real university would do is allow a 3rd party to datamine all the students to destroy their careers before they graduate.
Universities used to do all this stuff in house with super computers, computing labs, personal webspace, email, search engines, etc.
Kuyawa 2 hours ago [-]
Total sovereignty starts with your own OS, LLM, GPS, processors, devices mobile and desktop, etc. Everything else is just delusion
christkv 3 hours ago [-]
We have this discussion with some public customers who want to use LLMs in our products. So far there is no official policy for the public sector so we are telling them to bring their own LLM model either by deploying models to azure in the region they want thus sifting the responsibility onto their contract with Microsoft and off our plate or sign a contract where they acknowledge they understand the risks of using third party llms (we offer, open ai, claude and mistral as providers for now).
sevenzero 3 hours ago [-]
>The block is introduced because they want employees to use the services approved by the government office, including Microsoft's AI tool Copilot.
Meh
nalekberov 3 hours ago [-]
Why would you need “AI” in a government office to begin with? Companies are heavily invested in it because of FOMO, but what are they getting from “AI” that’s so essential?
Make no mistake, using AI can be quite helpful and sometimes is necessary. What I mean by “AI” is the way Big Tech packages and sells every kind of automation.
jgalt212 3 hours ago [-]
I would too if I were a foreign government. The risk of another Room 641A is too high.
sarmedshafi 44 minutes ago [-]
[flagged]
bogomind 3 hours ago [-]
[flagged]
giozadi 3 hours ago [-]
[flagged]
roschdal 2 hours ago [-]
[dead]
sehw 58 minutes ago [-]
[dead]
Rendered at 15:29:30 GMT+0000 (Coordinated Universal Time) with Vercel.
Sounds like they just want to maintain control over the outbound traffic which sounds rather sensible to me.
Yeah, and probably also forcing Zero Data Retention contracts on those service, instead of the consumer variants.
Of course something like what you describe could happen. But under the central case, ensuring some privacy (with the ability to seek damages if breached) whilst still providing access to frontier models seems like a reasonable trade-off with a lot of value.
That is called democracy. Where the good of citizens is valued above what big corporations want. To push up pollution and power prices so big American tech companies can play with AI seems something that only a mad king would do.
Big corporations are only big because they provide what customers want. They don't get to extract money from people's work, the way politicians can.
It's also so easy to astroturf to manipulate public opinion. If I were China, I'd post so much anti-datacenter content everywhere in the West to gain a leg up in the race to superintelligence, because we are dumb enough to let our citizenry influence these decisions.
Imagine if we did the same thing for the nuclear race. ASI is winner-take-all, the first one to ASI can just lock everyone else out.
Just because power used to be even cheaper in the recent past, by doing non-sustainable shit and pushing all the resulting costs onto others/the future does not mean that was ever appropriate, necessary or desirable, and everyone advocating for chasing that model is a greedy, selfish asshole in my view.
https://gcping.com/
Now, do we have DCs with "temporary gas generators" operating 24/7 that were thrown together in the last 2 years? Probably not.
If cloud based AI is any good, they will sell versions that can be hosted locally just like every other service since the beginning of the internet.
So only mildly surprised on reading the article to read they are intentionally forcing them onto a specific worse model.
You say that but that's not reflected in the law, and historically the us government has repeatedly created such sweeping surveillance systems. It's highly unlikely they only made it legal, and aren't using it sweepingly considering theyre on record doing so before it was legalized through the act before too...
And as that's international law... It's always kinda a coin toss whenever anyone actually pays it any attention. No real recourse if violated after all.
MS don't train your data
Here every person gets $500 of copilot "credits" per month and that is a lot of use. $500 in Anthropic API gets used in 3 days.
The only disadvantage is that copilot cli has a very crappy and limited plugin system. For example a plugin can register a hook when a model calls a tool, but it's impossible to show a question to a user from such plugin.
Also it's "Autopilot" mode is designed to waste tokens. It injects things like "did you do absolutely everything you can about this? If not continue" and it's impossible to disable this without reverse engineering.
(People actually came by my desk to see "the AI", the physical thing. It blows people's minds to realize AI doesn't need a data center, that it is just some computer parts sitting on a desk.)
The big hitter AI companies see the writing on the wall: open source models and local AI rigs will decimate the market for big AI in the next few years.
It, of course, runs on linux. I went with stock ubuntu so I could attach a screen and/or remote in to a full GUI. Having a full GUI also makes the rig more relatable to people who's eye glaze over when they see a terminal interface. "It's just a funny-looking desktop computer."
At 48GB of VRAM it can run basically any LLM I would want to download. Speeds are fine for a single user (Tok/s numbers change based on model/mode). But if I were using it for something like ComyfUI I would ditch the multiple 5060s and go with a 5070ti or 5080 as ComfyUI does better with a single powerful GPU.
I'm sure cloud models will always have a slight edge but most tasks, most of the time, won't need that few extra percentage points of performance.
Yes and no. I bought most of the hardware before the rampocalypse. It is just an AM4 chip on a nothing motherboard. Even today, 16GB 5060s are maybe 500 each. 64GB of DDR4 is another 500$. Add a power supply and pci risers and the basic parts could be purchased today for around 3000$... call it 4000$ all-in including my labor to get everything connected and talking to each other.
4000$ is money but is also almost nothing in the world of commercial IT purchases.
I don't know for ChatGPT but Claude claims that it will keep your chat private and not use your data for training if you are on a paid plan [1], unless you decide otherwise: "By default, we will not use your inputs or outputs from our commercial products (e.g. Claude for Work, Anthropic API, Claude Gov, etc.) to train our models."
The same statement is missing from the free plan policy page [2] So it's totally reasonable for a Government to block its staff from using free services as this may leak sensitive information. We are doing the same in my organization hoping to protect our intellectual property.
[1] https://privacy.claude.com/en/articles/7996868-is-my-data-us...
[2] https://privacy.claude.com/en/articles/10023580-is-my-data-u...
This is just an IT org asserting control over how data moves in and out of the business/government. Its seems pretty reasonable that a company/government would want a contract in place with any provider they are sending data to. Oblivious that is going to have costs in agility and picking the best tools, but this is reasonable information security behaviour.
I'm surprised they aren't taking the extra step and moving to restrict data sharing to only EU based firms given... geopolitics.
Totally logical and smart take. Any govt (or for that matter, anyone) not doing this is just giving all their data to these providers for free.
But then the story goes on and say MS Copilot is an approved AI... Sad thing to read.
On the other hand, the simplest explanation is that the Microsoft grip on those government agencies is strong and with them already exclusively using the Microsoft ecosystem like all swedish public employers are (including universities), it's only the natural next step to strongarm them into using exclusively their AI offering as well.
I do feel for the civil servants that have to use Copilot though, it was a breath of fresh air to move to Claude Code when I did, and if Copilot is half as bad as the Google Gemini document integration, which loves to give you variants of "I can not do that". I get why they don't want to use it.
> The risks of unregulated AI use have been noted within a number of authorities where there has also been reason to take other measures.
> Among them is the Swedish Transport Administration, where the internal audit earlier this year discovered widespread and risky use of about ten different AI services and wrote as follows:
> "We have seen several examples of problematic use of open AI services. The examples concern both the sensitivity of the information entered and how the AI-generated responses have been handled."
> Some staff will continue to have access to a dedicated platform for AI assistants—developed in-house by the Government Offices—which provides access to ChatGPT and Claude.
> Internal information also indicates that, following a review, security measures for the approved tool Copilot have been strengthened. However, the press office has declined to provide details regarding these enhancements, citing security considerations.
https://learn.microsoft.com/en-us/microsoft-365/copilot/secu...
I would suspect those headlines caused public officials to investigate how the public sector employees actually use AI chatbots.
I can't fathom why they would willingly try to migrate such critical operations away from a secure state-run system. I'm sure that system sucks in some ways. But those issues can be worked on, surely.
In the end, if employees are dissatisfied with Copilot, blocking Anthropic and OpenAI will just make people switch to their personal devices and use those services on their smartphones if necessary.
It's not about the model or who gets the bribe, like a few folks in this thread imply, it's simply the guarantees that Microsoft is able to give to a public institution about what happens to their data.
- Legal trust: Lawyers draft hundreds of pages specifying what may and may not be done with the data.
- Evidence-based trust: Looking at Microsofts actual track record, past privacy incidents, regulatory findings, and whether its data-handling practices have matched its disclosures and contractual commitments.
For the latter point, here is a nice summary from related to the use of Office prodducts in the Dutch goverment: https://www.privacycompany.eu/blog/new-dpia-on-microsoft-off...
This is most likely the key thing. At least here in Europe, already having the processor agreements set up - and Microsoft actually at least trying to do the bare minimum regarding compliance - is worth a lot, even for a nominally inferior product.
Across the bridge, in Denmark, we've already seen a number of cases where government employees have use various AIs to help them do their job (and in many case used an AI to fail at doing their job). The result has been information about citizens just being entered into whatever AI the employee fancied, without worry about leaking private and sensitive information. I'm not entirely convinced that the public employees strictly speaking needs an AI, but if they are going to use one regardless, it makes sense that it's one that has been approved, whatever that might mean.
https://code.claude.com/docs/en/gateways
Seems like a good way to govern usage to an alternate model provider
Some of my favorites: https://forums.macrumors.com/threads/apples-new-thing-ipod.5...
Thanks for this
Limiting the amount of tools sounds like a sane default in most cases.
Nothing in this necessarily say anything about one of the tools doing a better job than the other in this regard. It might say a little bit about trust though, warranted or not.
Universities used to do all this stuff in house with super computers, computing labs, personal webspace, email, search engines, etc.
Meh
Make no mistake, using AI can be quite helpful and sometimes is necessary. What I mean by “AI” is the way Big Tech packages and sells every kind of automation.