New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adds GCM Connector source #320

Merged

droid-mohit merged 60 commits into integration from new_integration/gcp

Jul 19, 2024

Contributor

Karansirohi2202 commented Jul 5, 2024

No description provided.

Karanveer Singh Sirohi added 8 commits

July 5, 2024 15:03


          adds changes for gcm connector source

233ffaf


          adds gcm api processor

517ffda


          adds gcm metadata extractor

cdc24fd


          adds gcm task proto

b602404


          adds gcm source manager

58f91ad


          adds gcm task executor result builder

b63b3b2


          adds gcm task executor result builder + 2

31b0d43


          adds migrations

b91286d

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

executor/source_task_executors/gcm_task_executor.py Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

protos/playbooks/source_task_definitions/gcm_task.proto Outdated Show resolved Hide resolved

droid-mohit reviewed

View reviewed changes

connectors/assets/extractor/gcm_metadata_extractor.py Outdated Show resolved Hide resolved

Karanveer Singh Sirohi added 8 commits

July 8, 2024 13:58


          adds api processor after changes

16505a7


          adds gcm task proto after changes

80dc9ed


          adds gcm source manager after changes

ef8c39d


          adds metadataextractor, api processor changes

21b4799


          added log_sinks in gcm metadata_extractor and api_processor

ce2695f


          adds asset manager


          added asset pb2.pyi file

dfb24a4


          adds gcm task executor after changes

f62c620

jayeshsadhwani99 and others added 17 commits

July 17, 2024 18:21


          Merge branch 'new_integration/gcp' of https://github.com/DrDroidLab/P…

3a7c582

…layBooks into @feature/gcp_ui


          metrics

1ee4220


          show step information

f71110c


          push migrations

df06746


          gcm logs form

1dc6660


          Merge branch 'integration' of github.com:DrDroidLab/PlayBooks into ne…

a90b7bd

…w_integration/gcp


          using mql queries to get the metrics

d9aa61b


          back merge with integration

e158bfd


          Merge branch '@feature/gcp_ui' of https://github.com/DrDroidLab/PlayB…

e8007d4

…ooks into @feature/gcp_ui


          Merge branch '@feature/gcp_ui' of github.com:DrDroidLab/PlayBooks int…

ce77e0c

…o new_integration/gcp


          fix gcm ui

b85a069


          Merge branch '@feature/gcp_ui' of github.com:DrDroidLab/PlayBooks int…

1fb3bb1

…o new_integration/gcp


          fix query

80c3353


          Merge branch '@feature/gcp_ui' of github.com:DrDroidLab/PlayBooks int…

e60fcd8

…o new_integration/gcp


          end to end testing for metrics done

4a0710c


          end to end testing of logs done

07c0720


          did some clean up

e473041

droid-mohit reviewed

View reviewed changes

connectors/assets/extractor/metadata_extractor_facade.py Outdated

               source_metadata_extractor_facade.register(Source.AZURE, AzureConnectorMetadataExtractor)
               source_metadata_extractor_facade.register(Source.GKE, GkeSourceMetadataExtractor)
               source_metadata_extractor_facade.register(Source.ELASTIC_SEARCH, ElasticSearchSourceMetadataExtractor)
+              source_metadata_extractor_facade.register(Source.GCM, GcmSourceMetadataExtractor)

Contributor

droid-mohit Jul 19, 2024

remove this from here for now

droid-mohit reviewed

View reviewed changes

media/assets/files/GOOGLE CLOUD MONITORING_data_1720774361_cf8a867937f44d689b99fdb8b8fc5c85.csv Outdated

		@@ -0,0 +1,9 @@
		insertId,jsonPayload,resource,timestamp,severity,labels,logName,sourceLocation,receiveTimestamp
		nvx9e674tt1hnzpz,"{'message': 'successfully renewed lease gke-managed-filestorecsi/filestore-csi-storage-gke-io-node', 'pid': '1'}","{'type': 'k8s_container', 'labels': {'location': 'us-central1', 'pod_name': 'filestore-node-wmpmj', 'container_name': 'gcp-filestore-driver', 'namespace_name': 'kube-system', 'project_id': 'doctor-droid', 'cluster_name': 'helm-test'}}",2024-07-12T08:51:49.605658407Z,INFO,"{'compute.googleapis.com/resource_name': 'gk3-helm-test-pool-2-523eb8cf-7kcn', 'k8s-pod/k8s-app': 'gcp-filestore-csi-driver', 'k8s-pod/pod-template-generation': '4', 'k8s-pod/controller-revision-hash': '577dbfdc89'}",projects/doctor-droid/logs/stderr,"{'file': 'leaderelection.go', 'line': '278'}",2024-07-12T08:51:50.626368588Z

Contributor

droid-mohit Jul 19, 2024

remove this file

droid-mohit added 10 commits

July 19, 2024 14:38


          back merge with integration

30d4f7c


          back merge with remote branch

c147b3d


          removes unwanted files

adb86fe


          updates impl for gcm source

7a9b524


          updates gcm logs contract

ffb0cf4


          adds gcm connector

25650d7


          back merge with integration

ced69bc


          updates form for gcm logs

d10629a


          Merge branch 'integration' of github.com:DrDroidLab/PlayBooks into ne…

5f2387c

…w_integration/gcp


          adds optional fields

5a66c2c

droid-mohit merged commit 4b79876 into integration

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment