Project to train image generator (LORA?) on networked Pi

Dec 24, 2024 Last reply: 1 year ago 2 Replies

I'm interested in playing with this, but I'm not interested in paying $3000 for a high-end nVidia NPU. It seems to be in principle possible to split the task into smaller subtasks that could be distributed to a Beowulf-style Pi cluster. Several enclosures exist that let you connect multiple Compute Modules over a high-speed bus, I hear.



I have minimal experience with Raspberry Pi (not zero, but minimal). I have none with setting up Beowulf clusters, and none with decomposing machine learning tasks and distributing them among processors. Thus, I wonder if there might be an existing project I could learn from and maybe even eventually contribute to, even if only as a tester.



Thanks.


There were some projects that used multiple PIs. From a cost and complexity standpoint they were more "because we can" rather than practical. A multicore AMD or INTEL processor would be a better option. If you skip the high power GPU the system cost is lower. Also the MPI cluster code is "off the shelf" for those processors.

formatting link

Join the Discussion

Have something to add? Share your thoughts — no account required.

Didn't find your answer?

Ask the community — no account required