Twitter Grader Follows @‘s

by Kenny on November 5, 2008

Just 2 days ago, I pos­ted about the update to the Twit­ter Gra­der algorithm.

In the post I cove­red how the algo update now counts follo­wer to follo­wing ratios in their sco­ring and some other cool stuff. I also made a recom­men­da­tion for the next update: “My recom­men­da­tion for the next algo update? Figure out a way to incor­po­rate user inte­rac­tion (@’s, ret­weets, replys) After all, it’s all about the con­ver­sa­tion ;)

Later that night, I recei­ved yet another com­ment from Dhar­mesh Shah, the deve­lo­per behind the Twit­ter Gra­der algo. He said:

Thanks for the second round of thought­ful analysis.

The algo­rithm was indeed upda­ted this wee­kend (and I think it’s “bet­ter”).
Quick note: We have 200,000+ uni­que pro­fi­les that have been gra­ded. In a way, this is good, but the flip side is that it takes some time to “nor­ma­lize” the data­base of gra­des. We’ve got sig­ni­fi­cant ser­ver resour­ces powe­ring the soft­ware, but I tend to “trickle-in” the recal­cu­la­tions. That’s a long-winded way of saying: It’s going to take some time for the actual gra­des to com­ple­tely reflect the upda­ted algorithm.

Making pro­gress (I think). The point about trac­king ret­weets and the “qua­lity” of con­ver­sa­tions for a given user pro­file is a really good one. I’ve been thin­king about that one and will try to incor­po­rate something like this in a future update.

Cheers,
Dharmesh

Well, it looks like the future update came soo­ner than expec­ted! 2 days is a pretty good turn-around time if you ask me! Today, lots of users are noti­cing a boost in their Twit­ter grade because of what I believe to be an incor­po­ra­tion into the algo of user-interaction.

Here are a few things to look at:

Just for good mea­sure, here are the charts, even though they are of less sig­ni­fi­cance this round..

Upda­ted Chart:

Recip Grader Followers

 

 

 

 

 

 

 

And the Pre­vious Chart:

 

 

 

 

 

 

 

Now, take a look at mar­tin­bow­ling, kate­mo­rris, and neo­blog. All of these users saw somewhat sig­ni­fi­cant jumps in their gra­des, without sig­ni­fi­cant inc­rea­ses in follo­wers or other acti­vity in upda­tes or follo­wing num­bers over the past 2 days.

BUT, take a look at these screenshots: (click for popup) mar­tin­bow­ling kate­mo­rris neo­blog

All of these users have a high volume of inco­ming @‘s, part of the user-interaction recom­men­da­tion that Dhar­mesh said would be incorporated!

But there’s more.. I also chec­ked @gary­vee’s score, who I have been moni­to­ring over the past few months. He has 18,352 follo­wers, follows 2,134, and 3,306 upda­tes. The past cou­ple months his score has varied from 99.9 to 100.1. But is noto­rious for not repl­ying to inco­ming @‘s that he recei­ves. Today, after the update, his score is down to a 99.7. Con­sis­tent with this trend is @chris­win­field, who also saw a slight drop in score today. Chris and I actually know each other apart from twit­ter, and he’s a great guy.. But, he gets a TON of @‘s because of all of the twit­ter polls and ques­tions that he does, but doesn’t @ back at nearly the volume that he gets them in. (sorry chris ;) )

This leads me to believe that Twit­ter Gra­der has incor­po­ra­ted in an update to their algo­rithm that accounts for inco­ming and out­going @‘s on your twit­ter account, like I had men­tio­ned in my last post.

If you find this to be true, leave a com­ment so I can check out your pro­file! And remem­ber tweeps, its all about the conversation!

Popu­la­rity: 2% [?]

{ 2 trackbacks }

Twitter Grader Part 4 - Kenny Hyder
December 1, 2008 at 4:58 pm
14 Tools of Highly Effective Twitter Users - Kenny Hyder
August 18, 2009 at 12:08 am

{ 8 comments }

Austin November 5, 2008 at 1:39 pm

sweet! All my @ing has finally paid off! hahaha

David Leonhardt November 5, 2008 at 5:05 pm

Well, just because I like being a rebel, I’ll take an oppo­sing view. Although some @ com­ments are worthwhile, one really has to be care­ful to pro­vide context…otherwise you end up filling up all your follo­wers’ home pages with unin­te­lli­gi­ble bits of con­ver­sa­tions. After a cou­ple weeks on Twit­ter, I have already dele­ted some peo­ple because all they do is add noise with no mea­ning to my page.

In 140 words, tweets really should be able to stand on their own. If I was in charge of gra­ding, I would give more weight to a per­son who is able to create tweets that do not result in a lot of @ noise.

admin November 5, 2008 at 8:47 pm

@david — that’s an inte­res­ting view, and I defi­ni­tely see your point, the pro­blem is, that it is very easy to say things that stand alone, and “spam” a twit­ter pro­file. Crea­ting con­ver­sa­tion that other peo­ple want to get invol­ved in iden­ti­fies you as a human, and an inte­res­ting one at that. User inte­rac­tion and colla­bo­ra­tion is the heart­beat of social media on the web.

Dharmesh Shah November 6, 2008 at 9:45 pm

Kenny: Thanks again for all of your time and effort. I think we’re at a point now where the gra­ding algo­rithm is rela­ti­vely decent. Always more work that can be done.

@david: I’m with Kenny on this one. I just don’t think that having stand-alone tweets is really a sig­nal of qua­lity that should be weigh­ted highly. These kinds of tweets are nearly indis­tin­guisha­ble from spam.

LPetrides November 7, 2008 at 1:59 am

Just curious: Ear­lier on, it also see­med that part of algo inc­lu­ded rela­tive strength of net­work (how many follo­wers the peo­ple you follo­wed or follo­wed you have). As someone who has single-handedly intro­du­ced twit­ter to dozens of peo­ple who have sub­se­quently crea­ted accounts (but are still new­bies them­sel­ves), is my score lower than if I just follo­wed or am follo­wed by the “big­gies” sco­ble etc.?

Dave L November 7, 2008 at 9:24 am

So this would seem to mean that moving DMs over to @‘s would inc­rease your grade.

Michael Russell November 8, 2008 at 3:18 pm

Really appre­ciate your insights into the mys­te­rious sau­sage grin­der that is the Twit­ter Gra­der algorithm.

Lord knows I’m not complainin’…I’m just thri­lled to find myself up in the 90-somethings with @laelaporte, @garyvee, @chrisbrogan and other notables.

Chris Blair June 28, 2009 at 9:47 pm

I know there were alot of issues with Twit­ter chan­ging the way @replies wor­ked with how they were sho­wing in the public time­li­nes, and it could be an inte­res­ting inves­ti­ga­tion to look at what “client” the peo­ple who go up/down from the new algo are/were using (eg are some clients recor­ding your @‘s with the twit­ter gra­der sys­tem bet­ter than others?) /// Another thing to moni­tor could be is a one word @reply saying “thanks” as valua­ble and worth as much as a full 140 cha­rac­ter res­ponse. Is a valua­ble res­ponse one that gets an @response back to your @response?

Comments on this entry are closed.

Previous post:

Next post: