Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

precheck runs out of memory for gfmpw-0d #172

Open
proppy opened this issue Nov 30, 2022 · 8 comments · May be fixed by #174
Open

precheck runs out of memory for gfmpw-0d #172

proppy opened this issue Nov 30, 2022 · 8 comments · May be fixed by #174

Comments

@proppy
Copy link

proppy commented Nov 30, 2022 •
edited
Loading

It seems that the precheck runs out of memory during klayout check causing the following traceback when being run on github actions:

{{STEP UPDATE}} Executing Check 3 of 4: Klayout BEOL
Traceback (most recent call last):
  File "mpw_precheck.py", line 141, in <module>
    default_content='_default_content')
  File "mpw_precheck.py", line 102, in main
    run_precheck_sequence(precheck_config=precheck_config, project_config=project_config)
  File "mpw_precheck.py", line 68, in run_precheck_sequence
    results[check.__surname__] = check.run()
  File "/home/runner/mpw_precheck/check_manager/__init__.py", line 156, in run
    self.klayout_cmd_extra_args)
  File "/home/runner/mpw_precheck/checks/drc_checks/klayout/klayout_gds_drc_check.py", line 20, in klayout_gds_drc_check
    with open(report_file_path) as klayout_xml_report:
FileNotFoundError: [Errno 2] No such file or directory: '/home/runner/work/tiny_user_project/tiny_user_project/precheck_results/30_NOV_2022___15_55_12/outputs/reports/klayout_beol_check.xml'

See https://github.com/proppy/tiny_user_project/actions/runs/3584751075/jobs/6032164785
@proppy proppy mentioned this issue Nov 30, 2022
Merged
@proppy
Copy link
Author

proppy commented Dec 1, 2022 •
edited
Loading

Maybe related to efabless/globalfoundries-pdk-libs-gf180mcu_fd_pr#1

@proppy
Copy link
Author

proppy commented Dec 2, 2022 •
edited
Loading

I think this is due to:
KLayout/klayout#1189

And likely to only happen in memory limited environment (like github actions).

It is fixed with:
KLayout/klayout#1193
but will only land in klayout 0.28 (in a few weeks)

@proppy proppy linked a pull request Dec 3, 2022 that will close this issue
Open
@proppy proppy changed the title Traceback with gfmpw-0b prechecks precheck runs out of memory for gfmpw-0d Dec 5, 2022
@whutddk
Copy link

whutddk commented Dec 5, 2022

I have the same problem.
https://platform.efabless.com/shuttles/GFMPW-0/project/1634
It can pass locally with 64GB memory. But failed online.
Can these project bypass the online precheck manually?

@gatecat
Copy link

gatecat commented Dec 5, 2022

I have the same problem with both of these projects:
https://platform.efabless.com/projects/1505
https://platform.efabless.com/projects/1589

A reduced size version of the latter does pass online fine:
https://platform.efabless.com/projects/1613

@gatecat
Copy link

gatecat commented Dec 5, 2022

Bumping klayout on the platform seems like the best solution here imo

@egorxe
Copy link

egorxe commented Dec 5, 2022

Same here https://platform.efabless.com/projects/1637 . Precheck passes locally with latest KLayout but OOMs on platform during FEOL CO.6a.

@AbdulMoizSheikh1
Copy link

Hi every one, I am having same issue for my projects.
https://platform.efabless.com/projects/1664 and https://platform.efabless.com/projects/1713
The FEOL is failing and after inspecting logs I am certain that this due to not running complete tests on the gds as the memory fills up and test fails. I have tried it with with 60 GB local machine but logs show same problem.
Is the memory use-age related to design size too??
Also is there any way to reduce the memory useage in FEOL stage as the memory use-age is too much and this makes designing on not very high end systems quite impossible.

@jeffdi
Copy link
Contributor

jeffdi commented Dec 6, 2022

Please go ahead and submit your project if you are able to successfully complete a precheck offline running locally.

Do submit a precheck job on the platform and also include a comment in the messages for your shuttle submission that your precheck passes successfully locally.

We will include it in the selection process and run the precheck and tapeout manually for your project. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

use hdl containers proppy/mpw_precheck
6 participants
@proppy @egorxe @whutddk @jeffdi @gatecat @AbdulMoizSheikh1