Twitter C/D

Oops. They are now having cascading failures. Rate limiting was clearly unintentional.

I can’t believe I still overestimate this dude.

probably not a good sign pic.twitter.com/TZFSOqU2Cg

— Kenny Keil (@kennykeil) July 1, 2023

I even followed Joe.

― Allen (etaeoe), Saturday, July 1, 2023 4:23 PM (thirty-three minutes ago) bookmarkflaglink

😤

yeah it’s not lookin good, decent chance that my last tweet is tweeting “I need a sugar daddy” at some bluecheck dipshit who insists that Musk has vastly improved the Twitter experience.

Shocked the limiting announcement didn't include 'blue checks don't count against views' - like, an actual reason for people (who want their posts seen) to subscribe to Twitter Blue instead of a measure that actively diminishes how often they're seen?

Oh right, makes sense

Forbes is both informative and sassy: Musky forgot to pay the data bill. 🙄 pic.twitter.com/gDjTMYzjgs

— Movies Silently 🐀 (@MoviesSilently) July 1, 2023

Fwiw I think the google bill is unlikely to be the culprit. They use google cloud for some internal systems. Twitter dot com runs on prem.

Unexpected behavior or bugs triggered by truly massive changes to the api being shipped on a holiday weekend seems more likely https://waxy.org/2023/07/twitter-bug-causes-self-ddos-possibly-causing-elon-musks-emergency-blocks-and-rate-limits-its-amateur-hour/

its a very silly idea that web scrapping no matter how EXTREME could constitute a significant portion of a huge site like twitters traffic

yup

i do like that phrase tho extreme web scraping might have to get into that

it’s very easy to throttle at a limit where it creates negligible load. that’s who’s it’s worked for 15 years. Presumably musk just feels like this is his data and there should be literally zero scraping load. So he asked his h1bs to ship api changes that break basically every client in a way that causes load to explode. genius stuff.

*how it’s worked

lol it’s back for me but my feed is mostly just people tweeting the numbers 1 to 600

still down for me but ive been able to look at tweets from by bot accounts the whole time

I saw a few hundred tweets and then got rate limited again lol

waxy article is incredible

lol is the “extreme web scraping” they’re seeing just their own web client firing off hundreds of requests due to a bug?

information wants to be extremely free

The day the public square got a cover charge.

It's pretty funny that the final straw for a lot of people was "not letting me look at this site all day long"

who

600 is just rereading my own posts

— Hadas Weiss (@weiss_hadas) July 2, 2023

Rate limits increasing soon to 8000 for verified, 800 for unverified & 400 for new unverified https://t.co/fuRcJLifTn

— Elon Musk (@elonmusk) July 1, 2023

you awake from a deep trance,
step away from the phone
to see your friends & family

— Elon Musk (@elonmusk) July 2, 2023

I hate that a musky loser was able to destroy something that, despite all the shit, was providing us with rapid news, a way to organize quickly, a place for mutual aid and a chance to form communities. I mean - of course it was always going to happen, but still.

— âpihtawikosisân (@apihtawikosisan) July 1, 2023

apologies, but does anyone here happen to have a Bluesky invite they might be willing to share with ... uh ... me?

Same same.

Same same.

Whatever you've done is hurting genuine users and is having a negative knock-on effect to verified users.
My followers can't like my tweets because they've hit a limit of liking.
See how mad that is?
You've actually stopped folk being able to express their positive feelings.

— Hedgehog Cabin (@HedgehogCabin) July 1, 2023

bluesky’s giving me a “account creation temporarily disabled” error right now, boo

Yeah, I think they paused it because they had an overwhelming rush of people signing up, for some reason.

it seems to be working fine today theyll prob turn reg back on soon

hell is empty and all the shitposters are here (on bluesky)

caek otm.

There’s no reason to believe this is related to their Google Cloud infrastructure. In addition to caek’s point that it wasn’t used for essential services, it’s, as far as I know, unprecedented for an account of Twitter’s size to be immediately suspended by _any_ cloud provider. Especially on Google Cloud as Google has the reputation of trying to save every possible deal. Nevertheless, it’s a useful reminder that cloud providers, for whatever reason, don’t have anything close to the regulatory framework other utilities do, so I think it’s still possible for them to immediately suspend customers.

I think the story isn’t more complicated than a cascading failure that’s extremely challenging to debug when the people who wrote the systems are MIA. I imagine this is why the engineers want to rewrite.

apologies, but does anyone here happen to have a Bluesky invite they might be willing to share with ... uh ... me?

― alpine static, Sunday, July 2, 2023 5:02 AM (seven hours ago) bookmarkflaglink

I’ve been getting some every few days. I’ll post them when I have them. But maybe they’ll slow down sending invite codes for a few days?

the weird rate limit was a nice little window into how twitter hydrates user timeline caches and what is/isn’t pre-populated

Some real high school vibes at Twitter right now, everyone on the site is actively celebrating the it’s demise while plotting ways to break it further

Yeah GCP doesn’t just cut off customers that spend hundreds of millions a year on the first of the month at midnight UTC.

There’s apparently a specific service to do with the creation and modification of load balancing/network abuse rules that ran on GCP. Unexpected loss of that could have triggered this problem but seems more likely that they shut it down deliberately last month to save money and effectively tied their hands behind their back when whatever actually caused this problem (which admittedly could have been actual abuse like musk seems to think) started off. These systems are so complicated and interconnected and it’s so hard to reason about whether it’s safe to remove a service. I can see why a rewrite is tempting when the only people who had a chance of reasoning like that are on a beach somewhere.

i will make them a new website i think i understand react server components now

I love doing my job at Twitter, where I am CEO. My job is liking the tweets of my CTO, who is also my boss. I have made no formal statement about my company effectively shutting down on a holiday weekend, and have left this up to my CTO/boss, who seems confused all the time pic.twitter.com/3wE713ff03

— Ed Zitron (@edzitron) July 2, 2023

Funny bcz it's true.

All of us still on Twitter as it gets worse and worse every day pic.twitter.com/6eASJtPJLn

— Sophie Hall (@SophLouiseHall) July 2, 2023

THE FIRST MAN IN LINE GRAB A TWEET. THE SECOND MAN GRAB REPLIES. WHEN THE FIRST MAN IS RATE LIMITED, THE SECOND MAN PICKS UP THE TWEET AND POSTS pic.twitter.com/VSKyD5yUSp

— Zane Schacht - Voice Goblin 🐀 (@VoicesByZane) July 2, 2023

You may think Twitter is dying but when there’s a Man Utd fan releasing a 1 hour 49 minute film of his own goalkeeper’s mistakes then I can assure you this app has never been more alive. https://t.co/OgHINCcyMF

— Hank Azulinger (@iammrazul) July 2, 2023

You may think Twitter is dying but when there’s a Man Utd fan releasing a 1 hour 49 minute film of his own goalkeeper’s mistakes then I can assure you this app has never been more alive. https://t.co/OgHINCcyMF

— Hank Azulinger (@iammrazul) July 2, 2023

Twitter's stopped me liking posts this morning.

On some level I'm glad as I don't enjoy the platform and am using it out of habit / to distract from a sentence that's proving difficult to construct.

And now I can't post either. I might actually get some work done today!