Transactional integrity is *not* a secondary goal. This is often bandied about when discussing distributed systems in the abstract but it's just not true at the scale of Facebook or Twitter. It's something we may be willing to relax in emergency scenarios but sites like Facebook are engineered to avoid relying on that as much as possible because it's an awful user experience. We don't relax integrity for performance optimization, we do it only if absolutely necessary during an incident to maintain overall site function.edge wrote: ↑Fri Sep 27, 2019 6:01 pm What do you think it does that is groundbreaking?
There were extremely high end and costly software packages to do what it does. But high costs kept adoption low.
Yes, writing code that can scale is a challenge. But really that’s something that market infrastructure type developers had to deal with for a long time. And at places like Facebook and LinkedIn they can optimize more easily because transactional integrity is a secondary factor. Imo LinkedIn is especially bad with how they have architected their solution. They optimized and architected their platform to the point where search, a key feature of any social graph, barely works.
yosef wrote: ↑Fri Sep 27, 2019 3:17 pmI don't know what this means; in what way is it not groundbreaking? Please don't mention MQ.
You can certainly argue that the products at LinkedIn, Facebook, etc are not groundbreaking in what they do. But as has been mentioned, the difficultly in producing them, and consequently the compensation for doing so, is based on the immense scale at which they must operate.edge wrote: ↑Wed Sep 25, 2019 8:08 pm There just isn’t anything particularly groundbreaking at linked in or Facebook etc etc.
Most of Silicon Valley these days is business model innovation not tech innovation.
Imo the interviewing and competitiveness has more to do with screening out the bottom 80% of the software development workforce who are marginal than it is about finding brilliant ground breaking research/innovator type guys.
I've really found the opinions from those outside tech in this thread entertaining, even if also insulting.
(I don't work for Facebook but I work for a company approaching their scale and have built systems to do exactly that)