Misplaced Pages:Version 1.0 Editorial Team

This is an old revision of this page, as edited by DocWatson42 (talk | contribs) at 07:53, 25 September 2022 (→Active projects: Made a minor correction per MOS:RANGE.). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Revision as of 07:53, 25 September 2022 by DocWatson42 (talk | contribs) (→Active projects: Made a minor correction per MOS:RANGE.)(diff) ← Previous revision | Latest revision (diff) | Newer revision → (diff)

This page in a nutshell: We are publishing selections of Misplaced Pages articles for offline use in Kiwix releases, in print, or for distribution on flash drives/memory cards.

Shortcuts

Misplaced Pages 1.0 — (talk) FAQ — To do

Release version tools Guide — (talk) — (stats)
Article selection process (talk) Version 0.8 bot selection Version 0.8 feedback
IRC channel (IRC)

Release criteria
Review team (FAQ)
Version 0.8 release (manual selection) (t)
"Selection" project (Talk) schools selection Offline WP for Indian Schools

CORE TOPICS CORE SUPPLEMENT Core topics - 1,000 (Talk) (COTF) (bot)

TORRENT (Talk)

"Selection" project for kids ((t))


WORK VIA WIKI PROJECTS (talk)


Pushing to 1.0 (talk)

Static content subcom.

This is the Version 1.0 Editorial Team page.

General background

Article ratings assessment scheme

In late 2003, Jimmy Wales had proposed making an offline release version of Misplaced Pages. This group was formed in late 2004 to meet this challenge. Our work involves identifying and organizing articles, and improving and maintaining a core set. Our work does not hinder the existing wiki process for creating and editing articles, but rather it supports that work by providing additional organization. We aim to produce collections that can be used in places where the internet coverage is expensive or non-existent. Our early collections were distributed via DVD; now these are shared via download, then distributed on hardware such as a Raspberry Pi. Originally, only a fixed selection was available, but there is now much flexibility in how selections can be made. This project is now mainly one point in a network of groups who collect and distribute open educational resources from the Internet in an offline form.

See these more detailed related articles:

How you can help

Main page: Misplaced Pages:Version 1.0 Editorial Team/To do

You are encouraged to join us and help out with one of the projects, or to discuss Misplaced Pages 1.0 on the talk page. A significant part of our work centers around maintaining the assessment scheme, which is now used on more than six million articles by over 2000 WikiProjects on the English Misplaced Pages. It is also being used on other language projects. Generally work on this team is sporadic – periods of hectic activity followed by long periods of waiting! Often work is long and tedious – checking through a list of 22,000 instances of profanities one by one, organizing 10,000 keywords taken from category names, or dealing with technical bugs when the assessment bot fails for no apparent reason. However, it is all worth it in the end.

Our strategy has been intensely debated, but the group has reached a consensus. We elected not to follow the German model. Instead we chose to start with a core of quality articles on key subjects and expand from there. We have produced three test versions: Version 0.5, Version 0.7, and Version 0.8 with the goal of releasing better collections of articles in due course. The next general release is generically referred to as "Release Version" while our first "official" comprehensive release will be called Version 1.0. These collections are then made available for offline use using a reader such as Kiwix, which was chosen as Sourceforge project of the month. The project was on hiatus for several years because of the loss of our main developer. However, as of February 2016, a new group of developers has begun work on upgrading the code and the process, in order to start producing new collections again, especially collections for schools.

Current needs

Although we have much of the requisite system automated, there are still some outstanding tasks:

Preparation of a reliable index. If you can write code and you're interested in how to map category trees into a useful index (not as easy as it sounds!) please contact Walkerma.
Reviewing manual nominations. Whenever there is a new release being planned, we need volunteers to review a few articles and process them.
Propose useful "guide" pages to be added, such as lists and disambiguation pages.
Check for vandalism in the selected version-IDs of the articles.
Develop nice pages for navigation through the content, such as subject portals.
Test the reader software, and find and report bugs.
Help with distribution, especially in remote areas without Internet access.

Please let us know on the Talk page if you can help with any of these.

Status

At present, the main activities are:

The assessment scheme, which is used by WikiProjects for organizing their content, using talk page tags and the WP1.0 bot. The bot was updated with completely new Perl code in 2020–2021, and it is currently maintained by User:Audiodude. Technical problems with the bot should be reported here. Related to this work is the WP1.0 server (previously called "Release Version Tools) which provides ways for WikiProjects to analyze article lists and data relating to their work.

Collaborations to produce offline collections are done in collaboration with various people from Kiwix and Internet-in-a-Box. Please contact Walkerma if you wish to help.

To select articles, we are mainly using a bot-assisted selection process based on assessment by individual WikiProjects, where articles are selected automatically based on quality and importance project rankings.

RevID selection

Based on discussions (at the 2017 Potsdam hackathon and since), we plan to reactivate RevID selection. Previously code based on WikiTrust was used in Version 0.8, and this appeared to produce a largely vandalism-free collection of articles. This worked by scoring each RevID based on the edits remaining in it, and choosing the most "trustworthy" recent RevID based on the WikiTrust algorithm.

Misplaced Pages 1.0 projects

Active projects

If you would like to start a new project, please discuss it on the talk page first before adding it here.

Misplaced Pages 1.0 Projects
Name	Summary of overall strategy	Coordinator	Description of activities
School selection	Put together selections of 1–10 GB sizes for use in high schools and elementary schools	User:Walkerma and others	Uses new code that starts with a seed and works out, guided by the WP 1 selection ranking to guide it
Work via WikiProjects (WVWP)	Use "networking" to mobilise our existing subject specialists	User:Walkerma	Organise and facilitate compilation of article lists from the WikiProjects and seek to identify important topics within each WikiProject's area of expertise. Locate important topics that are currently not being managed by projects. In conjunction with WP:COUNCIL, the project serves as a link with the editing community, and may later help locate expert reviewers.

Past releases

Past Misplaced Pages 1.0 Projects
Name	Summary of overall strategy	Month of release	Description of activities	Website	Next release
Version 0.5	A test release prior to release of Version 1.0 above.	April 2007	A test release designed to pave the way for Version 1.0. Used manual nominations and approval based on importance and quality. Approval was by only one person, from the review team.	Okawix	Version 0.7
Version 0.7	A test release of automated article selections, prior to release of Version 1.0 above.	Early 2010	A test release designed to pave the way for Version 1.0. Used SelectionBot to make an article selection based on importance and quality. Vandalism prevention used a script, with manual checks, which delayed the release significantly.	Kiwix, ZIM download	Version 0.8
Version 0.8	A test release of automated article selections, prior to release of Version 1.0 above.	March 2011	A test release designed to pave the way for Version 1.0. Version 0.8 used bot-assisted article selection, with manual adjustments based on feedback from WikiProjects. Used as a test of the WikiTrust revisionID selection code - this worked well.	Misplaced Pages:Version 0.8/downloads.	Version 0.9
2006 Misplaced Pages CD Selection (previously called "Test Version")	Work with release version done off site that was coordinated by BozMo	April 2006	2000 articles with content filtered/selected for use by children (see Misplaced Pages:Misplaced Pages CD Selection).	No longer available - see 2008/9 release below	2007 Misplaced Pages CD Selection (below)
2007 Misplaced Pages CD Selection	Work with release version done off site that was coordinated by BozMo	May 2007	4655 articles with content filtered/selected for use by children (see Misplaced Pages:Misplaced Pages CD Selection).	No longer available - see 2008/9 release below	2008/9 Misplaced Pages CD Selection (below)
2008/9 Misplaced Pages CD Selection	Work with release version done off site that was coordinated by BozMo	October 2008	5502 articles with content filtered/selected for use by children (see Misplaced Pages:Misplaced Pages CD Selection).	http://schools-wikipedia.org	Not yet known

Inactive projects

Inactive Misplaced Pages 1.0 Projects
Name	Summary of overall strategy	Coordinator	Description of activities
Authoritative Editions	Gives experts in each field the tools to review suitable articles in their area of expertise and give their okay to particular revisions.	Sj, Jeff Keller, Gnp	Allow editors to propose new groups; for example: "Featured Article review" or "American Physical Society peer review". Each blessing group would have a set of review guidelines. Each blessing group would consist of this set of guidelines, and a set of users who could bless a revision of an article as satisfying them. Articles with blessed revisions would display icons or links to last-blessed revisions.
Featured Articles First	reviewing older or problem FAs to ensure that quality is maintained, ready for inclusion of these articles in Misplaced Pages 1.0.		(Now a standard part of the FA system)
Geography project	to produce a descriptive gazetteer of the world for publication.		This could include an atlas, continents, countries and major cities. This would serve as a test bed for publishing Misplaced Pages 1.0, but could also be a valuable stand-alone product.
Three Level Editing	Users participate in a three part editing process to assure that pages are up to quality standards.		The first level is just a general check, the second level is a factual check, and the third level is a last "just in case" check. This process would assure that articles would be up to standards without putting too much responsibility on one user.
Biographies	Improve and assess biographical articles		Focus especially on the 200 Core Biographies, in conjunction with Misplaced Pages:WikiProject Biography. .
Dynamic Pocket Cyclopedia	Lists most important FAs, FLs, and GAs.		An evolving list of no more than half of Misplaced Pages's most important featured articles, featured lists, and designated good articles.
WikiSort	Integrate the sifting process into the Wiki.		Aims to use data from the planned user rating scheme to provide rankings of articles, such that important quality articles can be automatically identified for inclusion in Misplaced Pages 1.0. This project has been rendered obsolete by WikiProject-based assessments (see above).
Article assessment	To assess articles		This project has been rendered obsolete by WikiProject-based assessments (see above).

Publishing steps

The process of generating an offline version of a sub-selection of Misplaced Pages article is multistage. It needs many dedicated and singled-purposed operations. The following chart show how the WP1 project envisioned things in 2010.

Even if this chart is still, to a large extend, valid; we practice and envision things slightly differently nowadays. One of the most important paradigm change we had to make is to remove as much as possible human based manual activity because the amount of work is simply too high to be achieved in a reasonable amount of time. We tend now to automatize as much as possible the whole process. As a consequence the project is now predominantly focused on technology.

Technical approach

Support Wikiproject assessment effort

The first software created to support the WP1 project has been the User:WP_1.0_bot. First written in Perl by User:CBM and then slighly modified and maintained by a few other volunteers. In 2020 the bot has been totally rewritten in Python following modern development standards (API, automated tests, etc.) by User:Audiodude. The code base is available en developed on Github.

The WP1bot had and still have three traditional purposes:

gather assessments (via categories introduced on main namespace articles talk pages),
upload on Misplaced Pages logs & stats
provide key information & tools to Wikiproject on a dedicated Web service. The data can also be accessed through an API at api.wp1.openzim.org

Select article titles

...

Select article revision

...

Scrape selected articles for offline usage

...

Orchestrate periodic and multiple scraping

...

Publish and distribute offline snapshots

...

Statistics

The WP 1.0 bot tracks assessment data (article quality and importance data for individual WikiProjects) assigned via Talk page banners. If you would like to add a new WikiProject to the bot's list, please read the instructions at Misplaced Pages:Version 1.0 Editorial Team/Using the bot.

The global summary table below is computed by taking the highest quality and importance rating for each assessed article in the main namespace.

All rated articles by quality and importance
Quality	Importance
Quality	Top	High	Mid	Low	???	Total
FA	1,585	2,522	2,424	1,981	186	8,698
FL	180	702	773	695	100	2,450
A	372	684	790	581	92	2,519
GA	3,271	7,449	14,928	19,982	1,789	47,419
B	17,192	33,322	55,168	71,496	23,743	200,921
C	17,189	54,974	137,636	319,377	93,269	622,445
Start	18,567	93,170	419,932	1,653,856	416,260	2,601,785
Stub	4,236	31,312	277,242	2,813,998	760,073	3,886,861
List	4,951	17,485	54,868	204,018	81,998	363,320
Assessed	67,543	241,620	963,761	5,085,984	1,377,510	7,736,418
Unassessed	114	414	974	16,449	391,244	409,195
Total	67,657	242,034	964,735	5,102,433	1,768,754	8,145,613

About this table

General

Jimbo's proposal, Chicago Meetup - Jimbo's Oct 2004 ideas on how to get to 1.0.
Misplaced Pages:Pushing to 1.0 Early discussion page for brainstorming ideas, before this team was created.
meta:Misplaced Pages 1.0
meta:Static content group

Assessment and validation

Misplaced Pages:Article assessment
meta:Article validation and Misplaced Pages:Pushing to validation - argue the benefit of article validation and possible implementations
Misplaced Pages:Flagged revisions (similar to the older "stable versions")
Misplaced Pages:Footnotes
Misplaced Pages:Peer review
Misplaced Pages:Request for comment
Misplaced Pages:WikiProject Fact and Reference Check

Misplaced Pages books

Misplaced Pages:Books & meta:WikiReader - Misplaced Pages books are collections of articles from Misplaced Pages on a certain topic, in the form of PDFs published for download and intended to be printed, and also to be sold in printed form.
The Book Tool, and Wiki to print, a collaboration between the Foundation and OSI/PediaPress.

v t e Misplaced Pages community
For a listing of current collaborations, tasks, and news, see the Community portal. For a listing of ongoing discussions and current requests, see the Dashboard.
General community topics	Administration News The Signpost Goings-on In the media Meetups Mailing lists Wikipedians Statistics The Misplaced Pages Library Centralized discussion Village pump Idea lab Policy Proposals Technical Miscellaneous WMF Holidays Bots
Contents and grading	Requested articles Most-wanted articles Images needing articles Articles needing images Articles for creation WP:AFC/R WP:AFC/C Creating articles Help Vital articles Articles for improvement Peer review Good article nominations Featured article candidates Lists Pictures Topics Article translation Pages Main Page Errors
WikiProjects and collaborations	Directory Culture and the arts Geographical History and society Science, technology and engineering Misplaced Pages assistance and tasks Patrols Recent changes Counter-Vandalism Unit Accessibility Organizations category
Awards and feedback	Reward board Contests A nice cup of tea and a sit down Charitableness WikiLove Compliment before criticism Kindness Campaign Thanks!
Maintenance tasks	Task Center Open tasks Backlog Category Admin category Edit requests Category Database reports Category tracker Dusty articles Special pages New pages Recent changes Controversial issues
Administrators and noticeboards	Administrators' noticeboard Incidents Edit warring Vandalism Admin dashboard Admin requests Closure Page protection User permissions Sockpuppets Open proxies Revision deletion Oversight Request Usernames Changing Title blacklist OTRS Bureaucrats' Requests for adminship and bureaucratship Arbitration Committee Requests Enforcement
Content dispute resolution	Requests for comment Third opinion Dispute resolution noticeboard Biographies of living persons Conflict of interest External links Fringe theories Neutral point of view No original research Reliable sources
Other noticeboards and assistance	Regional notice boards Requests for help Category Asking questions Teahouse Help desk Reference desk Adopt-a-user Copyright assistance Copyright investigations Text problems Media questions Resource requests Mergers History mergers Moves Page importation Spam Blacklist Whitelist Bots Education General sanctions Editor sanctions Long-term abuse
Deletion discussions	Guide Admin Today Articles Templates Files Categories Redirects Miscellany Speedy Proposed BLP Review Undeletion Arguments to avoid Arguments to make Article Rescue
Elections and voting	Requests for comment (meta) Wikimedia Foundation elections WP Democracy Milestones
Directories, indexes, and summaries	Departments Edit summary legend Editor's index Essays FAQs Glossary Abbreviations Help Manual of Style Simplified Rules Five pillars Policies Guidelines Shortcuts Templates Citation templates Tips Today Tools Wiki markup
Media Category Templates

Misplaced Pages

:Version 1.0 Editorial Team - Misplaced Pages