Skip to content
This repository has been archived by the owner on Aug 29, 2020. It is now read-only.

Reorganising cluster data #144

Open
wants to merge 4 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
.PHONY: test

test:
docker-compose down
docker-compose run spec sh /app/test/run_tests.sh
docker-compose down
Comment on lines +4 to +6
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make sure that any docker containers that are hanging around don't accidentally contaminate test runs.

5 changes: 5 additions & 0 deletions data_sources/djornl.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
name: djornl
category: network
title: Jacobson Lab Exascale Networking data
home_url: https://github.com/kbase/exascale_data
data_url: https://github.com/kbase/exascale_data/releases/latest
52 changes: 52 additions & 0 deletions importers/djornl/manifest.schema.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,52 @@
{
"$schema": "http://json-schema.org/draft-07/schema#",
"title": "Exascale parser file manifest",
"type": "array",
"items": {
"type": "object",
"required": ["data_type", "path"],
"oneOf": [
{
"properties": {
"data_type": { "enum": ["cluster"] }
},
"required": [ "prefix" ]
},
{
"properties": {
"data_type": { "enum": [ "node", "edge" ] }
}
}
],
Comment on lines +8 to +20
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if the data type is "cluster", there must be a "prefix" field, which dictates the cluster label

"properties": {
"data_type": {
"title": "Data type",
"type": "string",
"enum": ["node", "edge", "cluster"]
},
"creation_date": {
"title": "File creation date",
"description": "date of file creation in the format YYYY-MM-DD",
"type": "string",
"format": "date"
},
"description": {
"title": "Description of the cluster set",
"type": "string"
},
"path": {
"title": "File path",
"type": "string"
},
"prefix": {
"title": "Prefix",
"type": "string",
"description": "The prefix to be used for clusters, e.g. markov_i2:4. Required for cluster data, not used for node or edge data"
},
"title": {
"title": "Name of the cluster set",
"type": "string"
}
}
}
}
Loading