the-stack-metadata

Dataset Card for The Stack Metadata Table of Contents Table of Contents Dataset Description Changelog Dataset Summary Supported Tasks and Leaderboards Dataset Structure Data Fields Usage Example Dataset Creation Considerations for Using the Data Additional Information Terms of Use for The Stack Dataset Description **Homepage:** https://www.bigcode-project.org/ **Repository:** https://github.com/bigcode-project **Paper:** https://arxiv.org/abs/2211.15533 **Leaderboard:** N/A **Point of Contact:** contact@bigcode-project.org Changelog |Release|Description| |-|-| |v1.1| This is the first release of the metadata. It is for The Stack v1.1| |v1.2| Metadata dataset matching The Stack v1.2| Dataset Summary This is a set of additional information for repositories used for The Stack. It contains file paths, detected licenes as well as some other information for the repositories. Supported Tasks and Leaderboards The main task is to recreate repository structure from the files of The Stack. Also, the set can be used for computing statistics and custom filtering or aggregation operations on The Stack. Dataset Structure Data Fields The set is split into buckets by repositories. There are 944 buckets. Additionally to the fields in the image, `ri` contains `min_repo_event_datetime` which is the ealiest date and time of an event for a repo after Jan 1 2015. As an example of an aggregation operation on The Stack, the image above shows conceptually a selection of stars ( and issues and PR count) for a file. Each unique file can be part of multiple repositories. So, The Stack releases unique files and aggregates meta information (e.g stars) from all repositories it belongs to. For example, for max_stars_count we take the maximum number of stars from all repositories the file is part of. The meta data will allow you to reconstruct repository directory structures. For this, for each repository form `ri` tabele it is needed to take all its files from `fi` table, find them in The Stack by