Why isn’t Twitter working? How Elon Musk finally broke his site – and why the internet might be about to get worse
It started like any other outage: unexplained error messages that told users they had hit their “rate limit”, and Twitter posts refusing to load. But as the weekend progressed, it became clear that these weren’t just any old technical problems, but rather issues that could define the future not only of Twitter but of the internet. Elon Musk took to Twitter on Saturday and announced that he would be introducing a range of changes “to address extreme levels of data scraping [and] system manipulation”. Users would only be able to see a limited number of posts, and those who are not logged in wouldn’t be able to see the site at all. That decision triggered those error messages, since users were hitting the “rate limit” that meant they were requesting too many posts for Twitter to be able to handle. The new limits – apparently temporary, though still in effect – meant that users were being rationed on how many tweets they were able to see, and would see frustrating and unexplained messages when they actually hit that limit. In many ways it was yet another perplexing and worrying decision by Mr Musk, whose stewardship of Twitter has lurched from scandal to scandal since he took over the company in October last year. (He appointed a chief executive, Linda Yaccarino, last month, but is still seemingly deciding, executing and communicating the company’s strategy.) But something seems different about the chaos this time around. For one, it is not one of the many content policy issues or potentially hostile ways of encouraging people to sign up for Twitter’s premium service that have marked Mr Musk’s leadership of Twitter so far; for another, it seemed to be part of a broader issue that is rattling the whole internet, and which Twitter might only be one symptom. It remains unclear whether Mr Musk’s latest decision really has anything to do with scraping by artificial intelligence systems, as he claimed. But the explanation certainly makes sense: AI systems require vast corpuses of text and images to be trained on, and the companies that make them have generated that by scraping and regurgitating the text that can be easily found across the web. Every time someone wants to load a web page, their computer makes a request to that company’s servers, which then provide the data that can be reconstructed on the user’s web browser. If you want to load Elon Musk’s Twitter account, for instance, you direct your browser to the relevant address and it will show his Twitter posts, pulled down from the internet. That comes with costs, of course, including the price of running those servers and the bandwidth required to be sending vast amounts of data quickly across the internet. For the most part on the modern internet, that cost has been covered by also sending along some advertising, or requiring that people sign up for a subscription to see the content they are asking for. AI companies that are scraping those sites make frequent requests for that data, however, and quickly. And since the system is automated, they are not able to look at ads or pay for subscriptions, meaning that companies are not paid for the content they are providing. That issue looks to be growing across the internet. Companies that host text discussions, such as Twitter, are very aware that they might be serving up the same data that could one day render them obsolete, and are keen to at least make some money from that process. It also looks to be some of the reason behind the recent fallout on Reddit, too. That site is especially useful for feeding to an AI – it includes very human and very helpful answers to the kinds of questions that users might ask an AI system – and the company is very aware that it is, once again, giving up the information that might also be used to overtake it. To try and solve that, it recently announced that it would be charging large amounts of access to its API, which serves as the interface through which automated systems can hoover up that data. It was at least partly intended as a way to generate money from those AI companies, though it also had the effect of making it too expensive for third-party Reddit clients – which also rely on that API – to keep running, and the most popular ones have since shut down. There is good reason to think that this will keep happening. The web is increasingly being hoovered up by the same AI systems that will eventually be used to further degrade the experience of using it: Twitter is, in effect, being used to train the same bots that will one day post misleading and annoying messages all over Twitter. Every website that hosts text, images or video could face the same problems, as AI companies look to build up their datasets and train up their systems. As such, all of the internet could become more like Mr Musk’s Twitter did over the weekend: actively hostile to actual users, as it attempts to keep the fake users away. But just as likely is that it is Mr Musk’s explanation for why the site went down conveniently chimes with the zeitgeist, and helpfully shifts blame to the AI companies that he has already voiced significant skepticism about. The truth may be that Twitter – which has fired the vast majority of its staff, including those in its engineering teams – might finally be running into problems with infrastructure that happen when fewer people are around to keep the site online. Twitter’s former head of trust and safety, Yoel Roth, is perhaps the best qualified person to suggest that is the case. He said that Mr Musk’s argument for the new limits “doesn’t pass the sniff test” and instead suggested that it was the result of someone mistakenly breaking the rate limiter and then having that accident passed off by Mr Musk as being intentional, whether he knows that or not. “For anyone keeping track, this isn’t even the first time they’ve completely broken the site by bumbling around in the rate limiter,” Mr Roth wrote on Twitter rival Bluesky. “There’s a reason the limiter was one of the most locked down internal tools. Futzing around with rate limits is probably the easiest way to break Twitter.” Mr Roth also said that Twitter has long been aware that it was being scraped – and that it was OK with it. He called it the “open secret of Twitter data access” and said the company considered it “fine”. And he too suggested that the events of the weekend could be a hint about what is coming to the internet, offering an entirely different alternative. It’s not Twitter, Reddit and other companies who should really be upset about what is going on, he suggested. “There’s some legitimacy to Twitter and Reddit being upset with AI companies for slurping up social data gratis in order to train commercially lucrative models,” Mr Roth said. “But they should never forget that it’s not *their* data — it’s ours. A solution to parasitic AI needs to be user-centric, not profit-centric.” Read More Twitter to stop TweetDeck access for unverified users Meta’s Twitter alternative Threads to be launched this week – report Twitter rival Bluesky halts sign-ups after huge surge in demand Twitter is breaking more and more Twitter rival sees huge increase in users as Elon Musk ‘destroys his site’ What does Twitter’s rate-limiting restriction mean?
2023-07-04 15:35
Time-Lapse Video Reveals Patterns in Penguin Huddle
What looks like a static clump of birds is actually a constantly moving and highly organized system.
2023-09-06 18:00
A dream come true – Pep Guardiola elated at position of treble-chasing Man City
Pep Guardiola says a week in which Manchester City can reach the Champions League final and win the Premier League again is a “dream come true”. Arsenal’s 3-0 defeat at home to Brighton following City’s victory by the same scoreline at Everton means Guardiola’s side can clinch a fifth title in six seasons next weekend. But before that City will have to get past holders Real Madrid in a home semi-final second leg to maintain their quest for a first Champions League triumph, with the tie level at 1-1. “It is a dream come true being here, honestly,” said Guardiola, whose side also have an FA Cup final against Manchester United to look forward to next month. “I know at the end we maybe don’t get all the trophies, people say we are a not good team, a ‘failure’ team, but it is a dream come true being here. “We are the only team in Europe fighting for all the competitions: the FA Cup final with Manchester United and still it is not over, the Premier League never ends, we know that from the past with Liverpool. “(We have) the semi-final at home with our people, second leg trying to reach the final of the Champions League. “Where we have come from previous seasons is an extraordinary season and hopefully we can finish well.” It is a dream come true being here, honestly. We are the only team in Europe fighting all the competitions Manchester City manager Pep Guardiola City, who are currently on an 11-match winning run in the league as part of a 22-game unbeaten streak in all competitions, can guarantee the Premier League title with victory at home to Chelsea next Sunday. But they will be confirmed as champions even sooner if Arsenal are defeated at relegation-battling Nottingham Forest on Saturday evening. Guardiola is taking nothing for granted but knows the win at Everton, after their draw in the Bernabeu, was key in keeping the Gunners out of reach. Everton went into the game on the back of an impressive 5-1 win at high-flying Brighton but a brace from Ilkay Gundogan either side of Erling Haaland’s 36th league goal of the season secured the points for City at Goodison Park. “When I see Chelsea and Brighton (City’s next two matches) we have a lot of work to do,” Guardiola added. “But this one (Everton) away was a tricky one. “I was really impressed by the way Everton handled the game against Brighton but from the first minute we controlled the game, except certain transitions. “They are the best in the Premier League from every free-kick and corner since Sean Dyche went in there, it is almost a goal every time. Arsenal lost here for one corner, so it happens. “We had the patience and momentum and movements from Riyad (Mahrez) and Phil (Foden) was really good in behind. We scored the goals in the right moment. “It was so important and nice to to celebrate with our fans away because they are always with us.” Read More Charity boss speaks out over ‘traumatic’ encounter with royal aide Ukraine war’s heaviest fight rages in east - follow live Wrexham plan talks with Ben Foster over whether he wants to carry on playing Nat Sciver-Brunt says mental health break helped put her in a ‘good place’ Jon Rahm and Scottie Scheffler are out on their own, says Curtis Strange
1970-01-01 08:00
RBA Is Studying Economic Impact of Climate Risks, Bullock Says
Australia’s central bank is developing its capacity to model the macroeconomic implications of climate risks for monetary policy
2023-08-29 15:40
Firewalkers in Greece honor Saint Constantine in mystery-shrouded, centuries-old rituals
Over three days at the end of spring, devotees of St. Constantine in a smattering of villages in northern Greece celebrate his feast with a series of intensely mystical rituals that include walking on beds of burning coals
2023-05-25 20:04
Who is Selema Masekela? Lupita Nyong'o reveals 'deception' caused dissolution of her relationship with boyfriend
Prior to their romance and the breakup post, Lupita Nyong’o had been extremely private about her life
2023-10-20 17:12
False fire alarm blares for several minutes at Women's World Cup match between Portugal and US
A fire alarm sounded for several minutes early in the second half of the Portugal-United States match at the Women’s World Cup on Tuesday
2023-08-01 16:30
World Cup-winning goal scorer Olga Carmona learns of father’s death minutes after final whistle
Spain's Olga Carmona's World Cup Celebrations have been marred by tragedy after she found that her father died just minutes after the game. The 23-year-old Real Madrid star secured a 1-0 win over England today in Sydney in the final. Carmona found out that her father died following the full-time whistle. Spanish FA said her father died just before the final got underway. Carmona posted an emotional tribute to her father after she helped her country to their first Women’s World Cup triumph. “Without knowing it, I had my star before the game started,” Carmona wrote. “I know that you have given me the strength to achieve something unique. “I know that you have been watching me tonight and that you are proud of me. Rest in peace dad.” The 23-year-old had celebrated her goal on Sunday with a tribute to a friend who recently lost her mother. “I think all of us, we felt that this team had something special,” the defender said after Spain won the title. Writing on Twitter, the Spanish FA said: "We deeply regret to announce the death of Olga Carmona's father. "The footballer learnt the sad news after the World Cup final. We love you, Olga, you are part of Spanish football history. "We send out most sincere hugs to Olga and her family in a moment of deep pain. "We love you, Olga, you are the history of Spanish football." A statement from Real Madrid read: “Real Madrid, our president and our board of directors are deeply saddened by the death of the father of our player Olga Carmona. “Real Madrid want to express our condolences and our love to Olga, her family and all her loved ones.” Carmona was named as player of the match in the final, after also scored a late winner in Spain's semi-final against Sweden. Read More Lionesses have ‘inspired millions’ despite falling short in first World Cup final Lionesses ‘won the hearts’ of fans despite World Cup defeat: ‘This is just the beginning’ Lionesses deserve honours after World Cup final run, says Labour leader Declan Rice is type of player everyone is looking for – Palace boss Roy Hodgson I’ll be there for him – Dele Alli always has friend in Spurs star Son Heung-min We won’t stop – Georgia Stanway vows England will ‘continue to break barriers’
2023-08-21 09:49
Florida elementary school principal and teacher are placed on leave after Black students are singled out at an assembly
The principal and a teacher at a Flagler County, Florida, elementary school are on paid administrative leave after an assembly was held only for fourth and fifth-grade Black students, who were collectively told to improve their school performance, according to the school district -- regardless of how each student was doing individually.
2023-08-25 13:31
Josko Gvardiol set for Manchester City medical after £77.5m deal agreed
RB Leipzig defender Josko Gvardiol is set for a medical at Manchester City in the next few days after the two clubs agreed a 90 million euros (£77.5million) deal. The Bundesliga side were said to be holding out for a fee of 100m euros (£86m) for the Croatia international, but City have been able to push the transfer through at a price that suits them. The 21-year-old is due in Manchester before the end of the week for a medical, the PA news agency understands. Gvardiol would add competition on the left side of City’s defence, having helped Croatia reach the semi-finals of the 2022 World Cup and then the final of the Nations League, where they were beaten by Spain. Midfielder Mateo Kovacic is so far City’s only summer signing, with the Croatian having moved from Chelsea in June. City saw captain Ilkay Gundogan leave for Barcelona on a free transfer and Riyad Mahrez last week completed a switch to Saudi Arabia club Al-Ahli in a £30m deal. The Premier League champions will take on Arsenal in the FA Community Shield at Wembley on Sunday. Read More Charity boss speaks out over ‘traumatic’ encounter with royal aide Ukraine war’s heaviest fight rages in east - follow live
2023-08-03 21:46
Football transfer rumours: Neymar agrees Barcelona return; Man Utd eye Onana
Saturday's football transfer rumours include Neymar, Amadou Onana, Michael Olise, Gift Orban & more.
2023-08-12 16:15
Folk's OT field goal in rain helps Titans snap 8-game skid with 27-24 win over Chargers
Nick Folk kicked a 41-yard field goal in overtime in a sudden downpour and the Tennessee Titans snapped an eight-game skid by beating the Los Angeles Chargers 27-24 Sunday
2023-09-18 04:23
You Might Like...
'An outrage' Matty Healy fumes over 1975's Grammy Awards snub
Benson Hill Announces Second Quarter Earnings Release Date
Louisiana lawmakers approve anti-LGBTQ+ bills that include ban on trans care for minors
Zayo Bolsters Global Network Infrastructure, Increases Capacity to Meet Rapid Bandwidth Demand
Why did HBO turn down 'Yellowstone'? Taylor Sheridan reveals network's problem with Kelly Reilly's character
Why Monty Williams deserved to be fired by the Suns
Medvedev defeats Eubanks in five sets to reach Wimbledon semi-finals
Opening night NBA MVP Power Rankings
