Google Summer of Code 2019/Graph compression: Difference between revisions
Jump to navigation
Jump to search
(Add weekly report 2019/33) |
(Add swh-graph git repo) |
||
| Line 3: | Line 3: | ||
* '''Student:''' Thibault Allançon | * '''Student:''' Thibault Allançon | ||
** [https://forge.softwareheritage.org/p/haltode/ forge activity] | ** [https://forge.softwareheritage.org/p/haltode/ forge activity] | ||
* '''Code:''' | |||
** [https://forge.softwareheritage.org/source/swh-graph/ swh-graph git] | |||
* '''Mentors:''' | * '''Mentors:''' | ||
** [[User:StefanoZacchiroli|Stefano Zacchiroli]] | ** [[User:StefanoZacchiroli|Stefano Zacchiroli]] | ||
Revision as of 12:03, 19 August 2019
- Title: Graph compression
- Description: The Software Heritage data model is a big Merkle DAG made of nodes like revisions, releases, directories, etc. It is a very big graph, with ~10 B nodes and ~160 B edges, which makes it hard to fit in memory using naive approaches. Graph compression techniques have been successfully used to compress the Web graph (which is slightly larger than the Software Heritage one) and make it fit in memory. The goal of this GSoC project is review existing graph compression techniques and apply the most appropriate one to the Software Heritage case, enabling in-memory processing of its Merkle DAG.
- Student: Thibault Allançon
- Code:
- Mentors:
- Stefano Zacchiroli
- Antoine Pietri
- Activity reports:
- March 2019
- April 2019
- May 2019
- June 2019
- July 2019
- August 2019
Links
- source code repository
- see project on the GSoC portal