I already get rate-limited like crazy on lemmy and there are only like 60,000 users on my instance. Is each instance really just one server or are there multiple containers running across several hosts? I’m concerned that federation will mean an inconsistent user experience. Some instances many be beefy, others will be under resourced… so the average person might think Lemmy overall is slow or error-prone.
Reddit has millions of users. How the hell is this going to scale? Does anyone have any information about Lemmy’s DB and architecture?
I found this post about Reddit’s DB from 2012. Not sure if Lemmy has a similar approach to ensure speed and reliability as the user base and traffic grows.
https://kevin.burke.dev/kevin/reddits-database-has-two-tables/
The ideal way that ActivityPub federation works IMO is a bunch of smaller nodes coming together to make a large network.
If you have a bunch of people all on one or two instances then you’ll have a “central hub” of the network that’s constantly overloaded.
That’s my advice to community builders on this platform… Spread out across smaller instances, don’t just all sign up to a big one.
Moving the scaling problem from a few instances to federation is likely to cause more harm than good.
I don’t see how syncing a post across a hundred instances is more efficient than having a hundred users see the post on one instance.