I would bet my trillion-dollar company on it because I understand how RAM works.

If you use NixOS, you don’t need to do any of that anymore. A single command in the CLI, and you have everything I do.

I did mention that in my case I had the 4080, but you do not need the 4080 whatsoever. You can run the same model with less context on a single £200 V100 or with the same amount of context on two of these.

Well I did in fact meaningfully combined them without an issue, that was the whole point of the blogpost.

Yes but it creates a bottleneck that negates the benefit of using multiple cards that way. Look into it. Cheers

Well it doesn’t matter because the bottleneck here is actually quite small for me. The issue is vram. If anything the bottleneck is my 4080.

Gotcha, I am not saying your setup is inherently wrong or useless. I am glad it works for your use cases. Godspeed

I think its a very fair thing you have flagged!

Building computers is very easy. I would suggest watching a YouTube video to get the general gist, and then once you buy the parts, just Google for whatever doesn’t go well.

I built my first Pentium 4 one when I was like six, so I’m sure someone much older that’s into tech can do it without an issue.

There are also tons of Discord communities that are willing to help you live if you encounter any issues.

I have written the blog post. I know empirically that I have used 0% AI while writing it. I also know LLM detectors are total BS and they don't really work. I have tried a couple on this exact blog post, and QuillBot, for example, gave me 0% AI detected on it.

I have then used a blog post of mine from 2021. QuillBot gave me 8%...

The King James version of the Bible came out at almost 100% AI generated a while ago. It was the HN front page.

Stop thinking that if someone writes in a way that is fun or looks like what you would think an AI writes, then it is AI generated. Loads of the time it is, but sometimes it's not, and it really hurts those like me.

> I have tried a couple on this exact blog post, and QuillBot, for example, gave me 0% AI detected on it.

Don't use Quillbot; not sure why, but their model is reluctant to classify anything as AI generated. I ran into this when proof-reading a students Phd - ChatGPT, Gemini, CLaude (and others) all agreed it was AI generated, but Quillbot said it wasn't.

So you are the AI?

I mean, seriously, which human says "the compute"?

I’m glad I’ve started this blog before the AI wave so I can prove people I’m just weird at writing.

It grinds my gears how so many people just talk about my writing style instead of the content.

What's interesting about the older post is that all the sentences are long, compared to the current datacenter GPU post which contains lots of short sentences.

But yeah, probably feels sucky to have your style analyzed for AI writing. FWIW, the datacenter GPU post was great! I went to look at the ebay postings.

Thanks!

I did get feedback on all sorts of things over the years.

One of them was to do with sentence lengths.

> I’m glad I’ve started this blog before the AI wave so I can prove people I’m just weird at writing.

Your previous blog posts didn't trigger any LLM detector (go on - check for yourself).

Neither does this one. I replied in another thread. It comes out as 0% and the one from 2021 comes out as 8%. LLM detectors are all BS

GPTzero says 100% AI generated for specific paragraphs that I chose (such as `Multi-token prediction`). If you remove all the code listings, tables, etc and just paste the prose into these tools, it drops to 87% AI generated.

None of the 3x older blogs of yours that I tried went above 5% AI generated.

Maybe you're spending so much of time with the LLM that you are talking like it; in which case, take an old blog and a recent blog, give the prose from them both to you favourite LLM and ask them if the same author wrote both. I just did that on ChatGPT and on Gemini, and both found that it is extremely unlikely that the same author wrote both.

Look, if all the SOTA LLMs agree that your recent blogs sounds generated, you can't blame the reader, can you?

GPTzero is a joke.

It thinks this is AI: “I bought a datacenter GPU that doesn’t even have a normal PCIe connector, stuck it in my gaming PC with an adapter, and now I have 32GB of VRAM across two GPUs running a 27 billion parameter model at 32 tokens per second.”

There’s nothing AI about that. Not all SOTA LLMs agree, hell, none of them do. The same exact example I sent here gives me 0% in some, 10% in others, 100% in GPTzero.

> Not all SOTA LLMs agree, hell, none of them do.

The ones I checked all agree: your recent writing is not the same author as your writing from 3 years ago...

You can check this yourself if you don't believe; make of that, what you will.

FYI, not a single line was AI written. If there is a hallucination, it’s fully mushy brain sourced.

Sorry for the false positive! It's interesting that multiple people thought that line was AI generated.

I think for me it was mainly the superlative "genuinely surprising" that made me wonder.

Agree. But I have not used AI in the slightest.

Some of us just write that. AIs had to learn it from somewhere.

AI didnt edit a single word of this post.