Comprehensive comment stats
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Comprehensive comment stats
(skip to stats if you just want to see the stats )
A while ago I was working on a mobile version of the website(the root, the part that contains the comic itself, not the forums ), and it worked by parsing everything from the page, including comments and comment names.(etc) So I got an idea: make a crawler and log/save everything! So I did so. I made a relatively simple crawler that downloads each strip's page and parses and logs everything on it.(comments, comment dates, strip image, alt tip, title, etc) And wrote another little script to parse all the logged data(so to speak) and generate the following data:
STATS!
GRAPH! Number of comments per strip:
X = time/strip
Y = comments
As you can see, the number of comments per strip has skyrocketed recently.
In total, readers have made 34552 comments.
In the last month, people have made (approximately)6418 comments.
In the last month, the average number of comments per strip is (approximately)493.69230769231.(precision! )
2624 different people have commented.
1099 people are one-time commenters and 52 people have commented 100 or more times.
Top 50 commenters:
1. Frank - 1540
2. Argent Stonecutter - 1495
3. FuRrY321 - 958
4. Valerio - 744
5. Thoth - 613
6. Gaboris - 515
7. Aerix "the Twilight" Spades - 506
8. BlueAnubis - 433
9. Dr. Prower - 394
10. Hopper200456 - 385
11. wingedwolfgirl - 360
12. Justice193 - 333
13. HonorèDerazey - 309
14. Spirit of the Wolf - 293
15. Fuzzypaws - 285
16. NobodyYouKnow - 280
17. Trefoiler - 274
18. Kamron - 266
19. psychoJoker36 - 246
20. sonic id furreh!!! - 237
21. rWolf1991 - 230
22. james319 - 223
23. Cerberus - 219
24. Snowmon - 187
25. valerio - 184
26. Rick Griffin - 171
27. Spirit Studios 2010 - 168
28. R-One - 167
29. Majin-Wolf - 164
30. Dissension - 164
31. GameCobra - 160
32. ReCreate(me!) - 154
33. The game - 152
34. Elwood Blutarsky - 151
35. Sleet - 147
36. CalaverX11 - 144
37. Zaiki - 130
38. Indagare - 118
39. D_Leo - 117
40. slacks315 - 116
41. Odos - 114
42. RageReaper - 113
43. Maxwell - 113
44. Val Kilmer Batman - 112
45. tahrey - 109
46. gagi - 107
47. Profesor Rod - 106
48. Inu225 - 106
49. Chip Uni - 104
50. IceKitsune - 102
(link to a text file with a list of all the commenters and how many times they've commented)
All-time top commenter: Frank
...whoever that is
Note: Data recorded on 7/19/2010(that's when the crawler collected all the data and the reason it took so long was because I procrastinated a lot and didn't get much time to work on the parsers >.>)
Note: ALL numbers are approximate, as the exact time of date when all data was collected was not logged.
Total time taken to crawl all the strips: aprox 30 minutes. Including downloading and parsing time.
Enjoy!
~ReCreate
edit: changed title to something less meh-ish
A while ago I was working on a mobile version of the website(the root, the part that contains the comic itself, not the forums ), and it worked by parsing everything from the page, including comments and comment names.(etc) So I got an idea: make a crawler and log/save everything! So I did so. I made a relatively simple crawler that downloads each strip's page and parses and logs everything on it.(comments, comment dates, strip image, alt tip, title, etc) And wrote another little script to parse all the logged data(so to speak) and generate the following data:
STATS!
GRAPH! Number of comments per strip:
X = time/strip
Y = comments
As you can see, the number of comments per strip has skyrocketed recently.
In total, readers have made 34552 comments.
In the last month, people have made (approximately)6418 comments.
In the last month, the average number of comments per strip is (approximately)493.69230769231.(precision! )
2624 different people have commented.
1099 people are one-time commenters and 52 people have commented 100 or more times.
Top 50 commenters:
1. Frank - 1540
2. Argent Stonecutter - 1495
3. FuRrY321 - 958
4. Valerio - 744
5. Thoth - 613
6. Gaboris - 515
7. Aerix "the Twilight" Spades - 506
8. BlueAnubis - 433
9. Dr. Prower - 394
10. Hopper200456 - 385
11. wingedwolfgirl - 360
12. Justice193 - 333
13. HonorèDerazey - 309
14. Spirit of the Wolf - 293
15. Fuzzypaws - 285
16. NobodyYouKnow - 280
17. Trefoiler - 274
18. Kamron - 266
19. psychoJoker36 - 246
20. sonic id furreh!!! - 237
21. rWolf1991 - 230
22. james319 - 223
23. Cerberus - 219
24. Snowmon - 187
25. valerio - 184
26. Rick Griffin - 171
27. Spirit Studios 2010 - 168
28. R-One - 167
29. Majin-Wolf - 164
30. Dissension - 164
31. GameCobra - 160
32. ReCreate(me!) - 154
33. The game - 152
34. Elwood Blutarsky - 151
35. Sleet - 147
36. CalaverX11 - 144
37. Zaiki - 130
38. Indagare - 118
39. D_Leo - 117
40. slacks315 - 116
41. Odos - 114
42. RageReaper - 113
43. Maxwell - 113
44. Val Kilmer Batman - 112
45. tahrey - 109
46. gagi - 107
47. Profesor Rod - 106
48. Inu225 - 106
49. Chip Uni - 104
50. IceKitsune - 102
(link to a text file with a list of all the commenters and how many times they've commented)
All-time top commenter: Frank
...whoever that is
Note: Data recorded on 7/19/2010(that's when the crawler collected all the data and the reason it took so long was because I procrastinated a lot and didn't get much time to work on the parsers >.>)
Note: ALL numbers are approximate, as the exact time of date when all data was collected was not logged.
Total time taken to crawl all the strips: aprox 30 minutes. Including downloading and parsing time.
Enjoy!
~ReCreate
edit: changed title to something less meh-ish
Last edited by ReCreate on Sun Jul 25, 2010 12:53 am, edited 3 times in total.
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry
Re: comment stats(OMG STATS)
ReCreate wrote:(link to a text file with a list of all the commenters and how many times they've commented)
This whole thing is epic, but wheres the link to that? :3
Fursona! :3
Don't judge each day by the harvest you reap but by the seeds that you plant.
-Robert Louis Stevenson
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Re: comment stats(OMG STATS)
Whoops. XD Fixed. (post edited, check now)Zander wrote:ReCreate wrote:(link to a text file with a list of all the commenters and how many times they've commented)
This whole thing is epic, but wheres the link to that? :3
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry
- Jimmy Jazz
- Posts: 846
- Joined: Sat Feb 21, 2009 10:16 pm
- Location: My tower of hay
Re: comment stats(OMG STATS)
Wait.... I've commented three times?...
Huh....
Huh....
what what? Jolly good time.
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Re: comment stats(OMG STATS)
Under the name of "Jimmy Jazz"(case-sensitive), yes.Jimmy Jazz wrote:Wait.... I've commented three times?...
Huh....
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry
Re: comment stats(OMG STATS)
I can tell it's case sensitive, You have two entries for me, under JiroDyne, and Jirodyne xDReCreate wrote:Under the name of "Jimmy Jazz"(case-sensitive), yes. :PJimmy Jazz wrote:Wait.... I've commented three times?...
Huh....
*Post* *Post* *Usurp The Forums Moderators* *Post* *Post*
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Re: comment stats(OMG STATS)
Yeah, Just add the 2 of them up. Recrawling and parsing everything, this time while being case-insensitive for a few entries isn't really worth it.Jirodyne wrote:I can tell it's case sensitive, You have two entries for me, under JiroDyne, and Jirodyne xDReCreate wrote:Under the name of "Jimmy Jazz"(case-sensitive), yes.Jimmy Jazz wrote:Wait.... I've commented three times?...
Huh....
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry
-
- Posts: 1446
- Joined: Fri May 21, 2010 10:29 pm
- Location: Here, Back and Better Than Ever!
- Contact:
- FlintTheSquirrel
- Posts: 2374
- Joined: Sat Mar 27, 2010 6:30 pm
- Location: Sweden/North Carolina
Re: comment stats(OMG STATS)
I am not even on the list. Yay!
Nice statistics by the way.
Nice statistics by the way.
Flint: Str 4, Per 9, End 5, Cha 4, Int 5, Agi 10, Luc 2
(Lucid's Drawing of Flint!)
The original idea of Flint is created by Cobalt Kitty
(Aqua's drawing of Flint!)
(Lucid's Drawing of Flint!)
The original idea of Flint is created by Cobalt Kitty
(Aqua's drawing of Flint!)
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Re: comment stats(OMG STATS)
Thanks. Coding the parsers took some time, and generating the numbers was even longer and more frustrating. But it was worth it.
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry
- Typhon
- Posts: 1008
- Joined: Sat May 08, 2010 1:16 am
- Location: In my house. Reading housepets. And organic chemistry.
Re: comment stats(OMG STATS)
I don't usually comment on the comic. I save it for the forums.
- fenning
- Posts: 156
- Joined: Sat Jul 10, 2010 12:39 am
- Location: Hopefully near Babylon Gardens...
- Contact:
Re: comment stats(OMG STATS)
Well now I'm just gonna try to comment as much as possible! HAHAHAHA!!!
Re: comment stats(OMG STATS)
wow! I'm 4th
Me approves of myself
ReCreate, I stay humble before you, you are the statwizard! All hail!
Me approves of myself
ReCreate, I stay humble before you, you are the statwizard! All hail!
- IceKitsune
- Posts: 5111
- Joined: Mon Apr 26, 2010 1:35 pm
- Location: Ohio
Re: comment stats(OMG STATS)
Yes Valerio, All hail ReCreate the Statwizard! Really I can't believe I ranked 50th I thought I would be much lower then that.valerio wrote:wow! I'm 4th
Me approves of myself
ReCreate, I stay humble before you, you are the statwizard! All hail!
Re: comment stats(OMG STATS)
2624 people have commented? My guess is that I am number 1450 lol
Re: comment stats(OMG STATS)
I'll take note of that. I look forward to your constructive, thoughtful, and intellectual comments on the comic.fenning wrote:Well now I'm just gonna try to comment as much as possible! HAHAHAHA!!!
Retired RP Character List (Sorry guys)
Richardson Valley: Venison and Ochen
Brookshire Meadows: Trinket
Oasis Towers: Jaxeh and Klack
Richardson Valley: Venison and Ochen
Brookshire Meadows: Trinket
Oasis Towers: Jaxeh and Klack
Re: comment stats(OMG STATS)
Wow! im number 95!!!
Staring at Chuck Norris for extended periods of time can cause eye damage and foot sized bruises to the face.
- Typhon
- Posts: 1008
- Joined: Sat May 08, 2010 1:16 am
- Location: In my house. Reading housepets. And organic chemistry.
Re: comment stats(OMG STATS)
If this Frank guy loves the comic so much he should join the forums lol
Re: comment stats(OMG STATS)
He might be one of those non-forum preferers.
"It is difficult to get a man to understand something, when his salary depends upon his not understanding it." - Upton Sinclair
Wanderer wrote:You don't need a job, you need money.
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Re: comment stats(OMG STATS)
I don't plan on collecting all the stats again any time soon. The stats aren't live, they're dated to the 19'th of this month. I may re-record stats in the distant future though. Like, one year or so.fenning wrote:Well now I'm just gonna try to comment as much as possible! HAHAHAHA!!!
And by the way: I had done this all in PHP(on a borrowed laptop), using flot for the graph. Here's the source files if anyone wants it, though its rather messy and entirely undocumented.(it also contains the raw data that is logged by the crawler, which is included)
lol XD stats wizard, though overlord would be more suitable. I got the idea from gagi and his thread.IceKitsune wrote:Yes Valerio, All hail ReCreate the Statwizard! Really I can't believe I ranked 50th I thought I would be much lower then that.valerio wrote:wow! I'm 4th
Me approves of myself
ReCreate, I stay humble before you, you are the statwizard! All hail!
I'm thinking of making some comprehensive stats of the forum... like average posts per day by analyzing the dates of the posts, overall activity, etc? Though crawling the entire forum would take quite a while, and I would probably have to remake a crawler in another language(php isn't really suitable) What do you guys think? Should I do it?
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry
Re: comment stats(OMG STATS)
most definitely, yes!
It would give the forum an even nicer touch of professionality.
It would give the forum an even nicer touch of professionality.
Re: Comprehensive comment stats
sweet ...
i sort of did a simmilar thing just when i joined the formuz https://www.housepetscomic.com/forums/v ... 91&p=57372
but i see you have put a bit more effort into it ....arff nice job ... and i never thought i would be on that list hehe .. o well yeyy for comments
funny stats would also be just to see how many comments got deleted ... and how those would effect the whole thing arff
i sort of did a simmilar thing just when i joined the formuz https://www.housepetscomic.com/forums/v ... 91&p=57372
but i see you have put a bit more effort into it ....arff nice job ... and i never thought i would be on that list hehe .. o well yeyy for comments
funny stats would also be just to see how many comments got deleted ... and how those would effect the whole thing arff
arff
Re: Comprehensive comment stats
THINK OF THE RAMIFICATIONS
(Oh and Frank does have a forum account by the way, he's posted 25 times)
I was going to make a joke but then I did.
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Re: Comprehensive comment stats
Grats ebly, you just made a joke i didn't get.
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry
Re: Comprehensive comment stats
I believe it's a correlation between the rise in the number of comments and the rise in the global temperature
THINK OF THE RAMIFICATIONS WHEN YOU POST COMMENTS, PEOPLE!!!
THINK OF THE RAMIFICATIONS WHEN YOU POST COMMENTS, PEOPLE!!!
-
- Posts: 532
- Joined: Thu Nov 26, 2009 7:54 am
Re: Comprehensive comment stats
Odd, I could have sworn that I commented once, but I'm not on the list. Oh well, maybe I some how managed to screw it up
Daniel Plainview- I DRINK YOUR MILSHAKE!
Here Comes The FuzzSinder wrote: Max can't snort catnip off Grape's chest?
Re: Comprehensive comment stats
tsk tsk tsk, my dear: the only universally accepted correlation with the rising of global temperature is the ever-reducing presence of pirates, although the apparente increase in activity, recently, led to some weather instability toward cold.Obbl wrote:I believe it's a correlation between the rise in the number of comments and the rise in the global temperature
THINK OF THE RAMIFICATIONS WHEN YOU POST COMMENTS, PEOPLE!!!
Re: Comprehensive comment stats
Well, I never said it was MY belief.valerio wrote:tsk tsk tsk, my dear: the only universally accepted correlation with the rising of global temperature is the ever-reducing presence of pirates, although the apparente increase in activity, recently, led to some weather instability toward cold.
Personally, I think it's all this dihydrogen oxide we've got floating about
Edit: Oh, and keeping on topic... I am number not-on-the-list! Wh00t!
- sliceofdog
- Posts: 283
- Joined: Sun Mar 21, 2010 1:46 pm
- Location: The Merry Land of Tea and Crumpets
Re: Comprehensive comment stats
XD I wonder if you heard that theory from the same source as me. Might you be a Pastafarian?valerio wrote:tsk tsk tsk, my dear: the only universally accepted correlation with the rising of global temperature is the ever-reducing presence of pirates, although the apparente increase in activity, recently, led to some weather instability toward cold.Obbl wrote:I believe it's a correlation between the rise in the number of comments and the rise in the global temperature
THINK OF THE RAMIFICATIONS WHEN YOU POST COMMENTS, PEOPLE!!!
Re: Comprehensive comment stats
That's pseudo.scientific nonsense. As everybody knows the reason for global warming is the decrease in the number of pirates.Ebly wrote:THINK OF THE RAMIFICATIONS
"It is difficult to get a man to understand something, when his salary depends upon his not understanding it." - Upton Sinclair
Wanderer wrote:You don't need a job, you need money.
- fenning
- Posts: 156
- Joined: Sat Jul 10, 2010 12:39 am
- Location: Hopefully near Babylon Gardens...
- Contact:
Re: Comprehensive comment stats
Mmmmyes. Mmmpirate loss.Liam wrote:That's pseudo.scientific nonsense. As everybody knows the reason for global warming is the decrease in the number of pirates.Ebly wrote:THINK OF THE RAMIFICATIONS
Re: Comprehensive comment stats
And not the only one, methinks!XD I wonder if you heard that theory from the same source as me. Might you be a Pastafarian?
Hooray! Rahrr!
Re: Comprehensive comment stats
It's science!fenning wrote:Mmmmyes. Mmmpirate loss.Liam wrote:That's pseudo.scientific nonsense. As everybody knows the reason for global warming is the decrease in the number of pirates.Ebly wrote:THINK OF THE RAMIFICATIONS
"It is difficult to get a man to understand something, when his salary depends upon his not understanding it." - Upton Sinclair
Wanderer wrote:You don't need a job, you need money.
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Re: Comprehensive comment stats
Guys youre derailing the thread. >:c
*picks up thread and places on rails*
>.>
*picks up thread and places on rails*
>.>
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry
Re: Comprehensive comment stats
Wow! This is amazing! I knew we had broken the record with Never Believe It’s Not So, but I hadn't imagined the tendancy to be like this. Did you go through all the pages taking the number, or is there some special software that can do that for you?
Also, I gues I do spend a lot of time commenting I don't come to the forums as much because when I do, I feel obligated to check all the topics that have been updated in my absence; which from my past experiences on forums, I know can take hours
Also, I gues I do spend a lot of time commenting I don't come to the forums as much because when I do, I feel obligated to check all the topics that have been updated in my absence; which from my past experiences on forums, I know can take hours
"[E]ven with simple tools, you too can make awesome."
―November 21, 2010
―November 21, 2010
- Typhon
- Posts: 1008
- Joined: Sat May 08, 2010 1:16 am
- Location: In my house. Reading housepets. And organic chemistry.
Re: Comprehensive comment stats
Hey, its Frank. Top commenter. Knew you were real and not an automated robot.Frank wrote:Wow! This is amazing! I knew we had broken the record with Never Believe It’s Not So, but I hadn't imagined the tendancy to be like this. Did you go through all the pages taking the number, or is there some special software that can do that for you?
Also, I gues I do spend a lot of time commenting I don't come to the forums as much because when I do, I feel obligated to check all the topics that have been updated in my absence; which from my past experiences on forums, I know can take hours
-
- Posts: 1415
- Joined: Sun Mar 28, 2010 6:09 pm
- Location: http://bordomirc.co.cc
- Contact:
Re: Comprehensive comment stats
I made special sofware to automate it. As explained in the first post. And lol, all hail the comment overlord!Frank wrote:Wow! This is amazing! I knew we had broken the record with Never Believe It’s Not So, but I hadn't imagined the tendancy to be like this. Did you go through all the pages taking the number, or is there some special software that can do that for you?
Don't let others define you, Only you can determine your fate
no longer active, sorry
no longer active, sorry