I thought this was somehow BitTorrent related. I read this article and am not really sure if this is something to be excited about? Can I run Deepseek R1 with whatever this is?
Since n300's came out, they have publicly shared their roadmap, so I've been waiting for next-generation hardware ever since. They have also announced p300 yesterday (that would put two Blackhole chips on one card, akin to what n300 did before)
So that would put a p300 unit at 64 GB GDDR6 and 1 TB/s bandwidth. Very competitive, considering that Tenstorrent is now the only vendor to offer scale-out at reasonable price point. Whoever figures out how to make it work with Corundum[1] for unlimited K/V cache offloading is going to make a lot of money: as agents spend more time executing tool-code, and de-coupled from chats, the individual jobs will take more and more time, so scheduling will become more important. How do you manage TB's of K/V cache concurrently?
People complaining about bandwidth are not seeing the bigger picture. Probably because they're unaware NVMe-oF exists, and never kept up with modern network topologies, because hyperscaler Kool-Aid doesn't include it.
Data goes in, AI emits hawking radiation out, in fancy patterns. Apt enough metaphor I guess.
Are the tenstorrent blackhole cards anyhow competitive?
Re-using a comment a wrote some time ago:
Tenstorrent really needs to put more VRAM on their cards.
If chinese companies can hack Nvidia GPUs with 48 or 96GB vram at a competitive price, surely Tensorrent can too.
Variants of n300d at $2500 for 48GB and $3900 for 96GB would be instant hits.
~~24GB for $1500 simply isn't gonna do it.~~ (old part of the comment related to the old n300 which can be update with: 32B for $1400 still isn't enough for success. There's some progress, but that's still too low considering it's exotic hardware that will lead to tons of compatibility issues).
Not clear how RISC-V is an AI accelerator? Is this a special build of a CPU, to look like a GPU?
Found answer: https://tenstorrent.com/faq
[flagged]
It's funny, that they sell a tensor accelerator, but do not mention its TOps anywhere.
Nice filter of models supported: https://tenstorrent.com/developers but needs that another filter for Blackhole RISCV p100a p150; my guess going by memory https://tenstorrent.com/hardware/blackhole it is up there with n300 https://docs.tenstorrent.com/aibs/wormhole/specifications.ht...