Merge branch 'dev' into szsz-gwas-catalog-harmonisation-dag

opentargets · Nov 11, 2024 · f562614 · f562614
2 parents 7c7e595 + e2f9d41
commit f562614
Show file tree

Hide file tree

Showing 35 changed files with 1,795 additions and 994 deletions.
diff --git a/docs/credible_set_qc/README.md b/docs/credible_set_qc/README.md
@@ -0,0 +1,17 @@
+## Credible set qc dag
+
+Credible set qc is a set of operations performed on the `StudyLocus` datasets originally finemapped by OpenTargets to:
+
+- Ensure pValue of each locus does meet the pre-defined threshold
+- Perform repartitioning of the credible sets, as the output from the batch job contains files per loci, resulting in slow queries.
+- Ensure no duplicated loci exist in the clean credible sets.
+
+![credible_set_qc](credible_set_qc.svg)
+
+The dag contains following steps:
+
+- qc of credible sets coming from `gwas_catalog_sumstats_susie` bucket
+- qc of credible sets coming from `ukb_ppp_eur_data` bucket
+
+> [!NOTE]
+> The outputs of the steps are contained in the target bucket with prefix _credible_set_clean_.
diff --git a/docs/credible_set_qc/credible_set_qc.svg b/docs/credible_set_qc/credible_set_qc.svg