Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

2024.07.02 #46

Open
5 of 13 tasks
seanmcilroy29 opened this issue Jul 2, 2024 · 5 comments
Open
5 of 13 tasks

2024.07.02 #46

seanmcilroy29 opened this issue Jul 2, 2024 · 5 comments
Assignees

Comments

@seanmcilroy29
Copy link
Contributor

seanmcilroy29 commented Jul 2, 2024


2024.07.02 Agenda/Minutes


Time 0800 (PT) / 1600 (BST) - See the time in your timezone

  • Chair – Adrian Cockcroft
  • Chair - Pindy Bhullar (UBS)
  • Convener – Sean Mcilroy (Linux Foundation)

Antitrust Policy

Joint Development Foundation meetings may involve participation by industry competitors, and the Joint Development Foundation intends to conduct all of its activities in accordance with applicable antitrust and competition laws. It is, therefore, extremely important that attendees adhere to meeting agendas and be aware of and not participate in any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws.

If you have questions about these matters, please contact your company counsel or counsel to the Joint Development Foundation, DLA Piper.

Recordings

WG agreed to record all Meetings. This meeting recording will be available until the next scheduled meeting.

Roll Call

Please add 'Attended' to this issue during the meeting to denote attendance.

Any untracked attendees will be added by the GSF team below:

  • Full Name, Affiliation, (optional) GitHub username

Agenda

Discussions

  • Fill in missing regional data for locations like Taiwan and Indonesia.
  • Add definitions and methodology references to the description document.
  • Investigate GPU monitoring libraries and interfaces for different providers.
  • Add carbon intensity sources like UN data for missing regions.

Renewable Energy Percentage

Issue submissions updated

Project Review

  • Start a GSF 2-week review for member feedback?

Spec Draft

  • Draft a Spec to support the dataset adoption

AOB

  • Topics added during the meeting

Next Meeting

  • 16 July

@seanmcilroy29
Copy link
Contributor Author

Attended

3 similar comments
@adrianco
Copy link
Contributor

adrianco commented Jul 2, 2024

Attended

@rootfs
Copy link

rootfs commented Jul 2, 2024

Attended

@metacosm
Copy link

metacosm commented Jul 2, 2024

Attended

@seanmcilroy29
Copy link
Contributor Author

MoM
Adrian opens the meeting at 0800 (PT) / 1600 (BST)

The group discussed the adoption of datasets, the need for a specification document, and the importance of reviewing and updating renewable energy percentages. They also discussed the potential benefits of open-sourcing carbon footprint data for cloud providers and the need for a centralized repository of carbon footprint data. Additionally, they touched on the importance of monitoring GPU power consumption in cloud providers and using Prometheus exporter for GPU support. Finally, they discussed the latest updates on GPU support, including the use of nb.

Data centre water usage and efficiency.
Adrian discusses formatting and releasing water usage data for Azure data centres. He highlights data centres' energy efficiency, notes the lack of granular data for AWS and Google, and proposes to update with 2023 data.

Cloud region metadata, filling in missing data, and investigating GPU monitoring libraries.
Chris believes that data should be open and freely accessible, with clear licensing. Adrian suggests importing data into CCF to boost adoption and usage. Additionally, Adrian talks about updating metadata for cloud regions and data centers, as well as using Internet Archive to timestamp data.

GPU monitoring and power consumption in cloud providers.
Adrian has proposed creating a standardized document for monitoring GPUs from different vendors. He mentioned that Google is involved in the project and that information on GPUs from various cloud providers needs to be gathered. The group discussed using Kepler for data analysis and the potential challenges of retrieving data from cloud providers. The Kepler project aims to integrate GPUs into Kubernetes with Nvidia support. Adrian plans to analyze Google and AWS annual reports for new numbers and insights.

Publishing IP address ranges for cloud providers.
Chris discussed how we can expose carbon intensity data using IP mapping, citing Amazon, Google, and Microsoft as examples. Adrian discusses the challenge of tracking AWS IP address ranges using a cumbersome spreadsheet and recommends using API consumption as a more manageable solution. Adrian proposes creating a pull request for the project and sending it to the wider group for review. Sean updates us on the review process and invites the steering committee to a meeting to discuss the project.

Action Items

  • Create a pull request for the 2022 data for review.
  • Review the pull request and provide any feedback or comments.
  • Investigate GPU monitoring interfaces and libraries for different providers.
  • Present an overview of the project to the GSF steering committee in two weeks.
  • Add Kepler's GPU support information to the Miro board.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants