I'm with you, Jim. And I completely agree with your suggestion that we come up with a review process and a means of identifying links in various stages of the review process. I only meant to recognize that the site's existing review mechanisms are also worthwhile and an excellent, important start. But we haven't yet started to use the tools we have and they are much simpler than a formal peer review process. These, to me, should be made use of first as they are in place. Then we should build in a formal process and identification system.
My thought: I think it's up to the group to decide whether we follow an academic model or a social media model or a mixture. But peer-review is definitely important, I agree.
I don't know where you stand on the legitimacy of wikipedia, a crowd-reviewed publication, but my view is that it's hard to argue that "crowd sourced" reviewing processes are not legitimate now, IMHO. They are not perfect; nor, however, can they be dismissed reasonably. Still, I agree that we will have to ensure that those with some credibility on a particular subject weigh in.
Best wishes,
David
----- Message from jimjutte@xxxxxxxxx ---------
Date: Mon, 30 Jan 2012 16:52:36 -0800 (PST)
From: Jim Jütte <jimjutte@xxxxxxxxx>
Reply-To: schoolforge-discuss@xxxxxxxxxxxxxxx
Subject: Re: Building on the Schoolforge.net site [school-discuss] Credibility of OA Texts
To: "schoolforge-discuss@xxxxxxxxxxxxxxx" <schoolforge-discuss@xxxxxxxxxxxxxxx>
Hi David,I like the idea of helpful, but what I was initially getting at is this. If you do a search for an academic journal article, the search can be filtered based on whether it is peer-reviewed. Now before you filter you can also see symbols beside each article to see which is peer-reviewed, which is not, among other categories. The legend is provided at the top of page to assist the reader on what the symbols mean. If you click the symbol it would take you to a description of the symbols as well.)
From: David Bucknell <david@xxxxxxxxxxxxxxxx>
To: schoolforge-discuss@xxxxxxxxxxxxxxx
Sent: Tuesday, January 31, 2012 12:52:33 AM
Subject: Re: Building on the Schoolforge.net site [school-discuss] Credibility of OA Texts
Here's a crazy question: There are other rating systems out there. For example, Ubuntu's software center (part of the OS now) comes with a reviewing system. Many software projects that we list are listed there, too. Can we draw on and add to or contribute to their review and rating system? How bout other similar systems on the Web or on other OS's?
One nice feature of the Ubuntu review system (and others on the Web) is a checkbox users can click to say whether they found the review helpful.
David
----- Message from david@xxxxxxxxxxxxxxxx ---------
Date: Mon, 30 Jan 2012 07:49:36 -0800
From: David Bucknell <david@xxxxxxxxxxxxxxxx>
Reply-To: schoolforge-discuss@xxxxxxxxxxxxxxx
Subject: Re: Building on the Schoolforge.net site [school-discuss] Credibility of OA Texts
To: schoolforge-discuss@xxxxxxxxxxxxxxxJim's thoughts bring us back to comments by LM and Justin about tying our work into the Web site. I am sure you all know that these two are largely responsible for the very impressive list of software titles now listed on the schoolforge.net site. It's becoming a very important resource in itself. So, I would like to second what I sense has been a proposal by these two people, because they understand its completeness and potential better than the rest of us, that we include it in our thinking in our new project.How?For starters, Jim's comment makes me think that the reviews and rating system on the site could be of use in vetting links to _any_ type of resource. But that would only be possible _if_ the links were actually reviewed and vetted.Can we make reviewing and vetting existing links a part of our new project?Can we then add the new texts as they get mentioned and review them, too?Finally, can we ask that we have a group-wide "committee" -- that is, that everyone on the list commit to reviewing one piece of software or another type of resource ... and rating it?It would certainly give our links more credibility wouldn't it?If you have a better idea, please "voice" it.Thank you,David----- Message from david@xxxxxxxxxxxxxxxx ---------
Date: Mon, 30 Jan 2012 07:24:28 -0800
From: David Bucknell <david@xxxxxxxxxxxxxxxx>
Reply-To: schoolforge-discuss@xxxxxxxxxxxxxxx
Subject: Re: [school-discuss] Credibility of OA Texts
To: schoolforge-discuss@xxxxxxxxxxxxxxx, Jim Jütte <jimjutte@xxxxxxxxx>
Cc: "schoolforge-discuss@xxxxxxxxxxxxxxx" <schoolforge-discuss@xxxxxxxxxxxxxxx>Hi, Jim.Let's say the second option occurs: we link to something done elsewhere. Your question is of obvious importance: how do we vet the resource to which we are linking?Criteria?A vetting process?Jim, should this be on the wiki somewhere?David----- Message from jimjutte@xxxxxxxxx ---------
Date: Mon, 30 Jan 2012 07:23:49 -0800 (PST)
From: Jim Jütte <jimjutte@xxxxxxxxx>
Reply-To: schoolforge-discuss@xxxxxxxxxxxxxxx
Subject: [school-discuss] Credibility of OA Texts
To: "schoolforge-discuss@xxxxxxxxxxxxxxx" <schoolforge-discuss@xxxxxxxxxxxxxxx>This is something occurred to me earlier today (China) and I suspect it may have already been mentioned, but if I don't mention it of course... it will get overlooked.As some here will already know, the credibility of a research article is generally best when peer reviewed. Even then, the odd article one will make it to publication and be found to be groundless.
May I suggest in the planning that if there are folks in the group developing texts, that there be criteria developed to provide support for the validity of the text so that the text is either appropriately supported or if needs editing, that that happens too. Second, if we choose not to write, can we find a way again to either show that a link/text is credible OR... if we choose not to, put up a disclaimer.
Personally in spite of the work, I feel that we should NOT be posting anything unless the writer/developer has met some sort of criteria, but of course there has to be developed criteria for the person/team to follow first...
Thanks for listening.
Cheers
----- End message from jimjutte@xxxxxxxxx -----
--
http://intknowledge.com
91 Suthisan, Dindaeng, Bangkok 10400
+66(0)84 329 1183 (cell); +66(0)2 693 8144 (Don't dial the zero (0) outside of Thailand.)
----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.
----- End message from david@xxxxxxxxxxxxxxxx -----
--
http://intknowledge.com
91 Suthisan, Dindaeng, Bangkok 10400
+66(0)84 329 1183 (cell); +66(0)2 693 8144 (Don't dial the zero (0) outside of Thailand.)
----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.
----- End message from david@xxxxxxxxxxxxxxxx -----
--
http://intknowledge.com
91 Suthisan, Dindaeng, Bangkok 10400
+66(0)84 329 1183 (cell); +66(0)2 693 8144 (Don't dial the zero (0) outside of Thailand.)
----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.
--
http://intknowledge.com
91 Suthisan, Dindaeng, Bangkok 10400
+66(0)84 329 1183 (cell); +66(0)2 693 8144 (Don't dial the zero (0) outside of Thailand.)