[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]

Re: Building on the Schoolforge.net site [school-discuss] Credibility of OA Texts



We've built a few rating systems - it's a well worn path, but one that requires planning, and attention to detail.

A few of the facets that need to be addressed here include:

1. The UI for rating, and how it fits in to the overall user experience of browsing content on the site;
2. Who can rate? If anon users can rate, we need to have some mechanism for deterring spam/gaming, as without that the ratings become unreliable and misleading, and flawed ratings are worse than no ratings;
3. If modding is involved, the same questions covered in 2 need to be addressed for 3; ie, who can mod, who can't, etc;
4. If site membership is required, who will support any member issues that arise? This also could potentially require a privacy policy (not difficult, something as simple as "We don't share your information" would probably be a start);
5. How will the ratings be reflected to people browsing content? Ratings are only as valuable as how they are reflected back.


I'd strongly recommend shelving building a ratings system until we have:

a. more content to rate;
b. actual issues with reliability;
c. a team of people ready to rate content;
d. clearly defined criteria to use to rate content; and
e. the time to design and build this system effectively

My .02 - please feel free to disagree :)

Cheers,

Bill

On Mon, Jan 30, 2012 at 8:52 AM, David Bucknell <david@xxxxxxxxxxxxxxxx> wrote:
Here's a crazy question: There are other rating systems out there.  For example, Ubuntu's software center (part of the OS now) comes with a reviewing system.   Many software projects that we list are listed there, too.  Can we draw on and add to or contribute to their review and rating system?  How bout other similar systems on the Web or on other OS's? 

One nice feature of the Ubuntu review system (and others on the Web) is a checkbox users can click to say whether they found the review helpful.

David

----- Message from david@xxxxxxxxxxxxxxxx ---------
    Date: Mon, 30 Jan 2012 07:49:36 -0800

    From: David Bucknell <david@xxxxxxxxxxxxxxxx>
Reply-To: schoolforge-discuss@xxxxxxxxxxxxxxx
Subject: Re: Building on the Schoolforge.net site [school-discuss] Credibility of OA Texts
      To: schoolforge-discuss@xxxxxxxxxxxxxxx

Jim's thoughts bring us back to comments by LM and Justin about tying our work into the Web site.  I am sure you all know that these two are largely responsible for the very impressive list of software titles now listed on the schoolforge.net site.  It's becoming a very important resource in itself.  So, I would like to second what I sense has been a proposal by these two people, because they understand its completeness and potential better than the rest of us, that we include it in our thinking in our new project. 

How?

For starters, Jim's comment makes me think that the reviews and rating system on the site could be of use in vetting links to _any_ type of resource.  But that would only be possible _if_ the links were actually reviewed and vetted.

Can we make reviewing and vetting existing links a part of our new project?

Can we then add the new texts as they get mentioned and review them, too?

Finally, can we ask that we have a group-wide "committee" -- that is, that everyone on the list commit to reviewing one piece of software or another type of resource ... and rating it?

It would certainly give our links more credibility wouldn't it?

If you have a better idea, please "voice" it.

Thank you,


David

----- Message from david@xxxxxxxxxxxxxxxx ---------
    Date: Mon, 30 Jan 2012 07:24:28 -0800
    From: David Bucknell <david@xxxxxxxxxxxxxxxx>
Reply-To: schoolforge-discuss@xxxxxxxxxxxxxxx
Subject: Re: [school-discuss] Credibility of OA Texts
      To: schoolforge-discuss@xxxxxxxxxxxxxxx, Jim Jütte <jimjutte@xxxxxxxxx>
      Cc: "schoolforge-discuss@xxxxxxxxxxxxxxx" <schoolforge-discuss@xxxxxxxxxxxxxxx>

Hi, Jim.

Let's say the second option occurs: we link to something done elsewhere.  Your question is of obvious importance: how do we vet the resource to which we are linking? 

Criteria?

A vetting process?

Jim, should this be on the wiki somewhere?

David

----- Message from jimjutte@xxxxxxxxx ---------
    Date: Mon, 30 Jan 2012 07:23:49 -0800 (PST)
    From: Jim Jütte <jimjutte@xxxxxxxxx>
Reply-To: schoolforge-discuss@xxxxxxxxxxxxxxx
Subject: [school-discuss] Credibility of OA Texts
      To: "schoolforge-discuss@xxxxxxxxxxxxxxx" <schoolforge-discuss@xxxxxxxxxxxxxxx>

This is something occurred to me earlier today (China) and I suspect it may have already been mentioned, but if I don't mention it of course... it will get overlooked.

As some here will already know, the credibility of a research article is generally best when peer reviewed. Even then, the odd article one will make it to publication and be found to be groundless.

May I suggest in the planning that if there are folks in the group developing texts, that there be criteria developed to provide support for the validity of the text so that the text is either appropriately supported or if needs editing, that that happens too. Second, if we choose not to write, can we find a way again to either show that a link/text is credible OR... if we choose not to, put up a disclaimer.

Personally in spite of the work, I feel that we should NOT be posting anything unless the writer/developer has met some sort of criteria, but of course there has to be developed criteria for the person/team to follow first...

Thanks for listening.
Cheers


----- End message from jimjutte@xxxxxxxxx -----

--
http://intknowledge.com
91 Suthisan, Dindaeng, Bangkok 10400
+66(0)84 329 1183 (cell); +66(0)2 693 8144 (Don't dial the zero (0) outside of Thailand.)



----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.


----- End message from david@xxxxxxxxxxxxxxxx -----

--
http://intknowledge.com
91 Suthisan, Dindaeng, Bangkok 10400
+66(0)84 329 1183 (cell); +66(0)2 693 8144 (Don't dial the zero (0) outside of Thailand.)



----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.


----- End message from david@xxxxxxxxxxxxxxxx -----

--
http://intknowledge.com
91 Suthisan, Dindaeng, Bangkok 10400
+66(0)84 329 1183 (cell); +66(0)2 693 8144 (Don't dial the zero (0) outside of Thailand.)



----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.