TestKube - Storing Results in MongoDB

[vasireddi78]

We are observing ‘bufio.Scanner: token too long’ error in MongoDB when testkube try to insert test results ( written from console.log ) from large performance test into MongoDB.

Can you please do the needful ?

[vsukhin]

Hey @tkonieczny Guess, we need to reproduce this case in order to see limitations we have

[tkonieczny]

I noticed this bufio.Scanner: token too long issue while I was doing performance tests a few weeks ago, but when I tried to reproduce it I wasn't able anymore.
I remember I did some output related checks https://github.com/kubeshop/testkube/blob/performance-tests/test/perf/stress-low.js (things like typo in baseURI, which resulted in huge output, etc.).

I remember in this case VSCode crashed when I tried to even paste the output, then I used vim, and just a few lines resulted in over 20MB file. So, I think it's related to line length and this limit: https://pkg.go.dev/bufio#pkg-constants

[vsukhin]

hey @vasireddi78 Do you have module and code line,where it happens?

[vsukhin]

Hey @vasireddi78 Just released new Testkube version. It will process long output results by chunks. Hope, it will help in ypur case

[vasireddi78]

Thanks a lot for your kind support ! Can you please let me know the testkube version these changes are incorporated ? Just to ensure that I am testing my use cases with right version testkube and contribute to testkube with benchmark performance test results. Regards, Ramu From: Vladislav Sukhin ***@***.***> Date: Wednesday, September 28, 2022 at 10:09 PM To: kubeshop/testkube ***@***.***> Cc: Vasireddi, Ramu ***@***.***>, Mention ***@***.***> Subject: [EXTERNAL] Re: [kubeshop/testkube] TestKube - Storing Results in MongoDB (Discussion #2386) *EXTERNAL SENDER* Hey @vasireddi78<https://urldefense.com/v3/__https:/github.com/vasireddi78__;!!OUOUp-U!_CBpZEr5GYUNHXPRxXQCgYKX0iJOK3ClRMI0zYiUXWqck6dX98keVYEk6D_uEq8a1fI4DPyYI30reHui_s7ffFUN5iM$> Just released new Testkube version. It will process long output results by chunks. Hope, it will help in ypur case — Reply to this email directly, view it on GitHub<https://urldefense.com/v3/__https:/github.com/kubeshop/testkube/discussions/2386*discussioncomment-3754974__;Iw!!OUOUp-U!_CBpZEr5GYUNHXPRxXQCgYKX0iJOK3ClRMI0zYiUXWqck6dX98keVYEk6D_uEq8a1fI4DPyYI30reHui_s7fmluR4e4$>, or unsubscribe<https://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A3JJY64XUNMER6X7JRRLLZDWARYDPANCNFSM6AAAAAAQWN5GB4__;!!OUOUp-U!_CBpZEr5GYUNHXPRxXQCgYKX0iJOK3ClRMI0zYiUXWqck6dX98keVYEk6D_uEq8a1fI4DPyYI30reHui_s7fv29UZIY$>. You are receiving this because you were mentioned.Message ID: ***@***.***>

…

________________________________ NOTICE: All information in and attached to the e-mails below may be proprietary, confidential, privileged and otherwise protected from improper or erroneous disclosure. If you are not the sender's intended recipient, you are not authorized to intercept, read, print, retain, copy, forward, or disseminate this message. If you have erroneously received this communication, please notify the sender immediately by phone (704-758-1000) or by e-mail and destroy all copies of this message electronic, paper, or otherwise. By transmitting documents via this email: Users, Customers, Suppliers and Vendors collectively acknowledge and agree the transmittal of information via email is voluntary, is offered as a convenience, and is not a secured method of communication; Not to transmit any payment information E.G. credit card, debit card, checking account, wire transfer information, passwords, or sensitive and personal information E.G. Driver's license, DOB, social security, or any other information the user wishes to remain confidential; To transmit only non-confidential information such as plans, pictures and drawings and to assume all risk and liability for and indemnify Lowe's from any claims, losses or damages that may arise from the transmittal of documents or including non-confidential information in the body of an email transmittal. Thank you.

[vsukhin]

1.5.39

[vasireddi78]

Thanks a lot for your kind support.

[vsukhin]

Welcome!