Twitter C/D

Are we reading a different story?

“On September 5th, Twitter experienced the loss of its Sacramento (SMF) datacenter region due to extreme weather. The unprecedented event resulted in the total shutdown of physical equipment in SMF,” Carrie Fernandez, the company’s vice president of engineering, said in an internal message to Twitter engineers on Friday.

like I know you have inside knowledge, but the story does talk about weather and extreme heat

Ultimately: were climate change conditions responsible for the cooling system failure or did it just fail regardless

ah, yeah sorry, skipped the quote from comms. "due to extreme weather" is ... arguable. can't say more. anyway yes, it's an interesting story! it's not interesting because “the internet is physical and also you can’t just accumulate infinite data and expect it to always be available”

i think its saying people think the internet is some magical always on thing but really its subject to the physical world, which is maybe true but doesnt really warrant the sage insight tone, i mean who gives a shit if twitter goes down really, except for caek who has to do some prob annoying work on it

― lag∞n, Tuesday, 13 September 2022 bookmarkflaglink

I get the sense from tech people that data will always be safe and available until the end of time (or the end of twitter).

So here we have a story where climate change is saying nope.

i don't think anyone in tech thinks that.

I do.

tech is full of the weirdest long termist / thought experiment / prepper people. these people are mostly insane, but you can't accuse them of blithely assuming that datacenters will never go down. they worry about a list of thing that includes asteroids.

if they had a magical belief that all data was safe then twitter would be down right now, and when it came back up it would be missing data.

That's what I'm saying, they have magical beliefs. There is definitely no logic to it.

this reminds me, do we have a thread about the long termist/effective altruism movement?

Recent discussion here - rationalism AI cultist creeps

don't put data centers at the north pole btw

― 𝔠𝔞𝔢𝔨 (caek), Tuesday, September 13, 2022 12:06 PM (thirty-three minutes ago) bookmarkflaglink

too late im doing it now

thank you xp

if you run a/c systems a lot more than usual they're likely to wear out, but sometimes they just... do that.. regardless. or break

one of those thing where I'd almost trust someone with an hvac background to manage a group of people administering a data center than I would some software developer who has worked their way up, because one group understands the rate of mechanical failure, and the other has a lot of weirdos who have brain holes

one interesting thing about this has been seeing the order in which they're letting people bring systems back up, which is very highly correlated with the amount of brain holes one associates with that subgroup of engineers. i.e. the less you know about software, the sooner you get back in.

and if you know anything about machine learning you're at the back of the line, which is 100% fair enough.

machines should not be allowed to learn

another reason “the internet is physical and also you can’t just accumulate infinite data and expect it to always be available” is dumb is its use of the word "infinite" tbh

one of those thing where I'd almost trust someone with an hvac background to manage a group of people administering a data center than I would some software developer who has worked their way up, because one group understands the rate of mechanical failure, and the other has a lot of weirdos who have brain holes

I have visited a large data center and this is close to the truth. One of the guys managing the data center talked about a certain piece of software for distributing work across machines as being rated to XX megawatts, which kinda floored me.

Maybe ‘the Internet is not eternal’ is a shock to people too young to have lost their Geocities pages.

they are amazing places. wish i'd gone into hardware tbh. i'm not sure if it's a problem or not that building them in a way that is truly resilient is beyond the abilities of everyone (including nation states) except aws, gcp and azure.

Print out your tweets, people!

i actually do run https://github.com/dogsheep/twitter-to-sqlite as a daily cron job

Perhaps compile them into a book… about hipster puppies.

i needlepoint all my tweets

You know--if there was a printer that was continuously printing out all the tweets ever tweeted on a single piece of paper, that paper would be long enough to... (1/18)

probably belongs on our tech jobs thread but since it's topical --

one of the data science/machine learning leads that left my employer earlier this year, along with everyone else who knew it was arriving, bought some machine learning in a crate hardware stack that's full of Nvidia A100s and it has two 3000W power supplies plus redundancies, so four power supplies total

it's been sitting in the crate outside of the data center in another state for a while. right now, they're trying to figure out how to plug it in to the grid in a way that can actually power the damn thing

ha yes, one downside of the crash in gpu prices is that it makes financial sense to own them rather than rent them again, but owning them is hard.

oh, I am guessing they ordered this thing before the prices dropped. it was like $250K

but if you look at, say, AWS gpu compute bills, you can still come out ahead

tbf "hey yall, the internet isn't immaterial, it depends on physical hardware" was a significant enough academic trend in the mid-2010s for a few scholars to make their reps on it—I'm not dissing those people, that work is all pretty good—but condescendingly chiding people about it in 2022 is silly. I met a cartoonist making a book about internet (and other) infrastructure a couple years back, but his book is for younger readers.

I just mumble the "yay, cloud!" catchphrase from the Microsoft commercials of yesteryear

whoever came up with the name the cloud was a genius, its confounded millions of people who had to watch a commercial during a football game

its sounds awesome but then youre like wait what the fuck

'cloud' is still currency in provincial government but then everyone here is stupid so

the cloud is really in our hearts

not in mine

no, you clicked the agreement

did the ilxbook ever get published or not?

Promoted tweets in the replies 🤮

my favourite thing on twitter is when I disagree about someone's annoying opinion about a song, then check their timeline to see the last two things they posted were retweets of oz katerji and jk rowling

I don’t know if anyone linked it previously but oh my god this thread

okay okay OKAY i’ll list Rolling Stone’s 500 Worst Albums

500. Moondance -- Van Morrison
499. Young Sheldon -- Radiohead
498. Turd Smokin’ -- The Turd Smoker Band
497. Well Whaddya Know 99 More Luftballoons How About That -- Nena
496. Songs to Fuck To -- Leonard Cohen

— blaine capatch (@blainecapatch) October 7, 2021

omg

now that is commitment to a bit

Well. This is new. pic.twitter.com/Vd1bvDiGQC

— unfriendly black hottie 🪩✨ (@battymamzelle) October 1, 2022

Shitty pro cop local news affiliate shamed into deleting a tweet by a product tweak that elevated the usual ratio to a more visible “this is a lie”.

My locked account with ~100 followers had been suspended for "hateful conduct" because I called Oz Katerji a cunt. Question is which one of the 100 dobbed me in and was it a relative?

couldve just been detected by their systems

Does that happen? It really seems to hate the word "cunt" and not really care much about the actual content of the tweet.

they def have systems that try to detect abusive speech, idk know really what theyre looking for tho