postgres high CPU

[electronicmax]

I've hit the 1million packet mark in the packets table and now i'm getting postgres consistently hitting 44-60% of my CPU - we should keep a watch on this and maybe figure out ways to stress postgres out less

also possibly help it with more RAM / buffers / whatnot?

[mcnutty26]

I think this is related to insert performance rather than general db load (I only see this once I start exceeding ~1000 packets/tick).

Commit ff8987e swaps the db insert mechanism from [multiple operations committed together] to [multiple values delivered in the same insert operation]

[mcnutty26]

Another thing to try if this doesn't do enough - double the length of the commit interval in the configuration file

[electronicmax]

this is back to being a bit of a problem.. python+postgres are cooking my machine again (each peaking occasionally at 100% , going down only to 79%)

[mcnutty26]

Is your loop interval set to something reasonable (5+)? Now that the loop is a couple of times faster you don't need to run it as often.

[electronicmax]

Indeed. Loop interval was 3, now 5. Still high CPU.