Difference between revisions of "Crawling project metadata (internship)"

From Software Heritage Wiki
Jump to: navigation, search
(add english translation)
 
(5 intermediate revisions by 2 users not shown)
Line 34: Line 34:
 
== Building the Semantic Web of FOSS projects ==
 
== Building the Semantic Web of FOSS projects ==
  
'''Context''': [https://www.softwareheritage.org/ Software Heritage], an
+
'''Context''': [https://www.softwareheritage.org/ Software Heritage] is an
 
ambitious research project whose goal is to collect, preserve in the very long
 
ambitious research project whose goal is to collect, preserve in the very long
term, and share the entirety of publicly accessible Free/Open Source Software
+
term, and share the whole publicly accessible Free/Open Source Software
 
(FOSS) in source code form.
 
(FOSS) in source code form.
  
 
'''Description''':
 
'''Description''':
There exist million of FOSS projects, hosted on hundreds of different hosting
+
FOSS is today a significant part of the software production of mankind:  there are millions
platforms, often with project duplications across several hosters. To navigate
+
of FOSS projects, developed on hundreds of different hosting platforms. Popular projects
and search through this maze of FOSS projects, one needs quick and easy access
+
are often cloned or forked, and many projects change their reference hoster platform during
 +
their lifetime, leading to a tangled web which is not easy to explore.
 +
 
 +
To navigate and search through this maze of FOSS projects, one needs quick and easy access
 
to the relevant project metadata, which are available in various formats and
 
to the relevant project metadata, which are available in various formats and
ontologies, such as DOAP or schema.org. The goal of this internship is to collect
+
ontologies, such as DOAP, ADMS.sw or schema.org. The goal of this internship is to collect
existing metadata, uniform them to some extent, and integrate them into the
+
existing metadata, reconciliate them to some extent, and integrate them into the
 
biggest FOSS source code archive of the world.
 
biggest FOSS source code archive of the world.
  
Line 52: Line 55:
 
* knowledge modeling and representation
 
* knowledge modeling and representation
 
* markup languages and manipulation of semi-structured data (HTML, XML, etc.)
 
* markup languages and manipulation of semi-structured data (HTML, XML, etc.)
* not strictly needed, but would be a plus: automatic classification and machine learning
+
* working knowledge of automatic classification and machine learning would be a plus
  
 
'''Workplace''': Inria Paris
 
'''Workplace''': Inria Paris
Line 65: Line 68:
  
  
[[Category:Available internship]]
+
[[Category:Completed internship]]
 
[[Category:Internship]]
 
[[Category:Internship]]
 
[[Category:Lang:French]]
 
[[Category:Lang:French]]
 
[[Category:Lang:English]]
 
[[Category:Lang:English]]

Latest revision as of 13:34, 26 September 2018

Construire le web sémantique des projets logiciels libres

(english description follows)

Contexte: Software Heritage, projet de recherche de grande envergure ayant comme but la récupération, l'archivage à très long terme, et le partage de la totalité du Logiciel Libre publiquement accessible en format code source.

Description: Ils existent des millions de projets de logiciels libres, hébergés sur des centaines de plateformes différentes, et souvent dupliqués. Pour naviguer dans ce graphe de projets logiciels, il est important de disposer de métadonnées pertinentes, et plusieurs efforts existent, autour de technologies du Web Sémantique comme DOAP ou schema.org. Le but de ce stage est de collecter les métadonnées existantes, les uniformiser, et les intégrer dans une des plus grandes collections de logiciels libres au monde.

Connaissances souhaitées pour accéder au stage:

  • information retrieval
  • modélisation et représentation des connaissances
  • manipulation de données semi-structurées (HTML, XML, etc.)
  • des notions de classification automatique et machine learning pourraient être utiles, mais ne sont pas indispensables

Établissement d'accueil: Inria Paris

Environnement: vous serez en immersion totale avec l'équipe qui construit l'archive de Software Heritage, et vous aurez la possibilité d'observer de près la construction d'un projet d'envergure mondiale.

Encadrants:

  • Roberto Di Cosmo <roberto@dicosmo.org>
  • Stefano Zacchiroli <zack@upsilon.cc>


Building the Semantic Web of FOSS projects

Context: Software Heritage is an ambitious research project whose goal is to collect, preserve in the very long term, and share the whole publicly accessible Free/Open Source Software (FOSS) in source code form.

Description: FOSS is today a significant part of the software production of mankind: there are millions of FOSS projects, developed on hundreds of different hosting platforms. Popular projects are often cloned or forked, and many projects change their reference hoster platform during their lifetime, leading to a tangled web which is not easy to explore.

To navigate and search through this maze of FOSS projects, one needs quick and easy access to the relevant project metadata, which are available in various formats and ontologies, such as DOAP, ADMS.sw or schema.org. The goal of this internship is to collect existing metadata, reconciliate them to some extent, and integrate them into the biggest FOSS source code archive of the world.

Desirable skills to obtain this internship:

  • information retrieval
  • knowledge modeling and representation
  • markup languages and manipulation of semi-structured data (HTML, XML, etc.)
  • working knowledge of automatic classification and machine learning would be a plus

Workplace: Inria Paris

Environnement: you will work shoulder to shoulder with all members of the Software Heritage team, and you will have a chance to witness from within the construction of the ultimate source code archive.

Internship mentors:

  • Roberto Di Cosmo <roberto@dicosmo.org>
  • Stefano Zacchiroli <zack@upsilon.cc>