[BUG] obsidian freezes on enabling the plugin #334

Mahgozar · 2023-12-31T10:04:06Z

Problem description:
in installing the plugin and when i enable it on my 8000 notes vault it shows the notification for indexing and after a few seconds obsidian freezes. i can see the ram and CPU usage climb up (nowhere near the limits of my machine)
when i run it with the developer console open it tells me that its stopped before an out of memory crash
but my machine has 16 gigabites of ram this shouldn't be a problem i think (although i have to mention the total size of the vault is 27 gigabytes)

Your environment:

Omnisearch version: 1.20.2
Obsidian version: 1.5.3
Operating system: Arch linux
Number of indexed documents in your vault (approx.): 8000 notes approaximately 14000 files in total

Things to try:

Does the problem occur when Omnisearch is the only active community plugin: yes
Does the problem occur when you don't index PDFs, images, or other non-notes files: yes
Does the problem occur after a cache reset: yes

Mahgozar · 2023-12-31T12:28:03Z

i did a little more tinkering the problem seems to be with my .excalidraw files that are interpreted as really really really big text files
and because of that they make the whole thing fall apart is there anyway to fix this?
perhaps a way to exclude a certain folder path from indexing?

Mahgozar · 2023-12-31T14:15:28Z

upon more testing the problem seems to be with JavaScript heap out of memory

but the problem is that when i run obsidian using a higher maximum i can't get it to go beyond 4g for some reason it just doesn't listen

scambier · 2023-12-31T14:36:16Z

I'll add a setting to make indexing of excalidraw files an opt-in, as a quick fix.

And increasing memory limit in Electron seems to be quite fiddly, if not straight up impossible if you can't build yourself :/
electron/electron#2056

Mahgozar · 2023-12-31T14:44:30Z

yeah i've been googling all over the past 6 hours :)))) couldn't find a thing, thank you for the response

Mahgozar · 2023-12-31T14:46:45Z

just an idea, can we change anything in that .asar file of obsidian to perhaps make this work differently? i have very limited programming knowledge so i have no idea if this even makes sense

scambier · 2024-01-05T20:35:08Z

If you update Omnisearch, I added a (hidden) setting excalidrawIndexing. You can modify it in yourvault\.obsidian\plugins\omnisearch\data.json. If you can confirm it "solves" the freeze at startup I'll add a toggle in the settings page 👍

Mahgozar · 2024-01-06T20:53:57Z

unfortunately the same problem still very much exists

scambier · 2024-01-07T16:54:17Z

Ok so the crash happening while indexing an excalidraw file was just a coincidence. It's possible that your vault is somehow too large for Omnisearch; or actually, Omnisearch's RAM consumption during indexing is too high for Electron.

Could you try this test build? I've reduced the size of batches during indexing, and added pauses between each batch to (hopefully) let the GC do its thing. omnisearch_1.20.4-bugfix.334.1.zip.

You can extract the files right next to the data.json you previously edited.

Moyf · 2024-01-18T13:06:53Z

I'm not sure if our problem is same, but when enabling Omnisearch, my OB would stuck for seconds.
The console shows:

Is this normal?
I have 'bout 700+ md files, and 3000 files at all.

scambier · 2024-01-19T17:02:03Z

Is this normal? I have 'bout 700+ md files, and 3000 files at all.

Not the same problem, as it looks like Omnisearch is correctly indexing your files. If you have a large cache, it can indeed freeze Obsidian for a few second while all the data is processed and loaded in memory.

scambier · 2024-06-27T14:28:29Z

@Mahgozar I have recently updated the cache loading mechanism. Does this issue still persist?

Mahgozar · 2024-06-29T10:36:57Z

when i run it with omnisearch it still freezes, im trying to run it for longer periods of time to see what happens but it freezes and gives the following error

obsidian --js-flags='--max-old-space-size=10192'
2024-06-29 10:29:05 Loading main app package /usr/lib/obsidian/obsidian.asar
Removing partition for vault mx-player-3652a80ff677f479
2024-06-29 10:29:05 Checking for update using Github
2024-06-29 10:29:06 Success.
2024-06-29 10:29:06 Latest version is 1.6.5
2024-06-29 10:29:06 App is up to date.
[77645:0629/135943.252984:ERROR:gl_surface_presentation_helper.cc(260)] GetVSyncParametersIfAvailable() failed for 1 times!
[77645:0629/135943.258412:ERROR:gl_surface_presentation_helper.cc(260)] GetVSyncParametersIfAvailable() failed for 2 times!
[77645:0629/135946.060361:ERROR:gl_surface_presentation_helper.cc(260)] GetVSyncParametersIfAvailable() failed for 3 times!
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)

Mahgozar · 2024-06-29T11:10:50Z

this is the results after 30 minutes
the results are the same without the js flags

obsidian --js-flags='--max-old-space-size=10192'
2024-06-29 10:37:12 Loading main app package /usr/lib/obsidian/obsidian.asar
Removing partition for vault mx-player-3652a80ff677f479
2024-06-29 10:37:12 Checking for update using Github
2024-06-29 10:37:16 Success.
2024-06-29 10:37:16 Latest version is 1.6.5
2024-06-29 10:37:16 App is up to date.
[78206:0629/140738.204375:ERROR:gl_surface_presentation_helper.cc(260)] GetVSyncParametersIfAvailable() failed for 1 times!
[78206:0629/140738.205620:ERROR:gl_surface_presentation_helper.cc(260)] GetVSyncParametersIfAvailable() failed for 2 times!
[78206:0629/140738.223039:ERROR:gl_surface_presentation_helper.cc(260)] GetVSyncParametersIfAvailable() failed for 3 times!
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)
Error sending from webFrameMain:  Error: Render frame was disposed before WebFrameMain could be accessed
    at s._sendInternal (node:electron/js2c/browser_init:2:89062)
    at _._sendInternal (node:electron/js2c/browser_init:2:73537)
    at node:electron/js2c/browser_init:2:101430
    at new Promise (<anonymous>)
    at Object.invokeInWebContents (node:electron/js2c/browser_init:2:101177)
    at _.executeJavaScript (node:electron/js2c/browser_init:2:74499)

Mahgozar · 2024-07-01T06:10:36Z

tested again after the new update as well, still faced with out of memory errors

scambier added the bug Something isn't working label Jan 1, 2024

scambier added a commit that referenced this issue Jan 5, 2024

#334 - Added a user-hidden setting to index excalidraw files

763fbb5

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BUG] obsidian freezes on enabling the plugin #334

[BUG] obsidian freezes on enabling the plugin #334

Mahgozar commented Dec 31, 2023

Mahgozar commented Dec 31, 2023 •

edited

Loading

Mahgozar commented Dec 31, 2023

scambier commented Dec 31, 2023

Mahgozar commented Dec 31, 2023

Mahgozar commented Dec 31, 2023

scambier commented Jan 5, 2024

Mahgozar commented Jan 6, 2024

scambier commented Jan 7, 2024 •

edited

Loading

Moyf commented Jan 18, 2024

scambier commented Jan 19, 2024

scambier commented Jun 27, 2024

Mahgozar commented Jun 29, 2024

Mahgozar commented Jun 29, 2024 •

edited

Loading

Mahgozar commented Jul 1, 2024

[BUG] obsidian freezes on enabling the plugin #334

[BUG] obsidian freezes on enabling the plugin #334

Comments

Mahgozar commented Dec 31, 2023

Mahgozar commented Dec 31, 2023 • edited Loading

Mahgozar commented Dec 31, 2023

scambier commented Dec 31, 2023

Mahgozar commented Dec 31, 2023

Mahgozar commented Dec 31, 2023

scambier commented Jan 5, 2024

Mahgozar commented Jan 6, 2024

scambier commented Jan 7, 2024 • edited Loading

Moyf commented Jan 18, 2024

scambier commented Jan 19, 2024

scambier commented Jun 27, 2024

Mahgozar commented Jun 29, 2024

Mahgozar commented Jun 29, 2024 • edited Loading

Mahgozar commented Jul 1, 2024

Mahgozar commented Dec 31, 2023 •

edited

Loading

scambier commented Jan 7, 2024 •

edited

Loading

Mahgozar commented Jun 29, 2024 •

edited

Loading