TinkerPop Gremlin backend for WebGraph (internship)

From Software Heritage Wiki
Revision as of 09:58, 15 July 2022 by StefanoZacchiroli (talk | contribs) (mark internship as completed)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Context: Software Heritage is an ambitious research project whose goal is to collect, preserve in the very long term, and share the whole publicly accessible Free/Open Source Software (FOSS) in source code form.

Description: Software Heritage uses the WebGraph framework for graph compression. This allows to manipulate the huge archive Merkle DAG in RAM efficiently, via the swh-graph component. The current RPC API to navigate the graph is however very limited and ad hoc. We would like to exploit the current compressed graph representation using a standard graph traversal language such as the Gremlin graph traversal language. The goal of this internship is to design, implement, and experiment with a backend for Apache TinkerPop (a popular open source implementation of Gremlin) that sits on top of WebGraph. If successful it will allow to traverse the huge Software Heritage graph with both the current efficiency and the convenience of a high-level and expressive graph traversal language.

Desirable skills to obtain this internship:

  • Java development
  • basic knowledge of graph theory

Will be considered a plus:

  • experience with the implementation of graph-based applications

Workplace: on site at Inria Paris (contact mentors for remote opportunities)

Environment: you will work shoulder to shoulder with all members of the Software Heritage team, and you will have a chance to witness from within the construction of the great library of source code.

Internship mentors:

See also