{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":34194075,"defaultBranch":"dev","name":"nDPI","ownerLogin":"ntop","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2015-04-19T04:56:52.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/12014789?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1704989697.0","currentOid":""},"activityList":{"items":[{"before":"b15337a32bcff7a0b0734cb60c6984229f07a7e5","after":"85501c9aaabf207b04e3fe961825385f9519f633","ref":"refs/heads/dev","pushedAt":"2024-07-23T06:50:27.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"FPC: add DPI information (#2514)\n\nIf the flow is classified (via DPI) after the first packet, we should\r\nuse this information as FPC","shortMessageHtmlLink":"FPC: add DPI information (#2514)"}},{"before":"65e31b0ea34c1b73639dd0d36af3674223b2af2f","after":"b15337a32bcff7a0b0734cb60c6984229f07a7e5","ref":"refs/heads/dev","pushedAt":"2024-07-22T17:20:44.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Add OpenWire support (#2513)","shortMessageHtmlLink":"Add OpenWire support (#2513)"}},{"before":"67f5cdafc0a704275d5f51a86b6a01fa36a69389","after":"65e31b0ea34c1b73639dd0d36af3674223b2af2f","ref":"refs/heads/dev","pushedAt":"2024-07-22T15:42:23.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"FPC: small improvements (#2512)\n\nAdd printing of fpc_dns statistics and add a general cconfiguration option.\r\nRework the code to be more generic and ready to handle other logics.","shortMessageHtmlLink":"FPC: small improvements (#2512)"}},{"before":"2a3f4dc8b400e078b7fd2ec0f802200dfece8c94","after":"67f5cdafc0a704275d5f51a86b6a01fa36a69389","ref":"refs/heads/dev","pushedAt":"2024-07-22T09:34:07.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"FPC: add DNS correlation (#2497)\n\nUse DNS information to get a better First Packet Classification.\r\n\r\nSee: #2322\r\n\r\n---------\r\n\r\nCo-authored-by: Nardi Ivan ","shortMessageHtmlLink":"FPC: add DNS correlation (#2497)"}},{"before":"be0b2c2d904efca17fa8f266ec48321268e64271","after":"2a3f4dc8b400e078b7fd2ec0f802200dfece8c94","ref":"refs/heads/dev","pushedAt":"2024-07-19T09:22:35.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Performed some grammar and typo fixes (#2511)","shortMessageHtmlLink":"Performed some grammar and typo fixes (#2511)"}},{"before":"92d0b8d91f6a88f1be350ed21c863a17ba433825","after":"be0b2c2d904efca17fa8f266ec48321268e64271","ref":"refs/heads/dev","pushedAt":"2024-07-18T18:35:47.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"ipaddr2list.py, ndpi2timeline.py: reformatted (#2509)","shortMessageHtmlLink":"ipaddr2list.py, ndpi2timeline.py: reformatted (#2509)"}},{"before":"c35a5ca087bdace26d454dd73337a63f04f23e20","after":"92d0b8d91f6a88f1be350ed21c863a17ba433825","ref":"refs/heads/dev","pushedAt":"2024-07-18T17:40:09.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"ndpi_strncasestr: optimization, fixes, tests (#2507)","shortMessageHtmlLink":"ndpi_strncasestr: optimization, fixes, tests (#2507)"}},{"before":"ca429669ac5b8f0101d0933ff20ee5f152c518b1","after":"c35a5ca087bdace26d454dd73337a63f04f23e20","ref":"refs/heads/dev","pushedAt":"2024-07-18T15:32:49.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"shell: reformatted, fixed inspections, typos (#2506)\n\nReformatted shell scripts according to [ShellCheck](https://github.com/koalaman/shellcheck/).\r\n\r\nI. Most common changes:\r\n1. https://github.com/koalaman/shellcheck/wiki/SC2086\r\n\t`$var` → `\"$var\"`\r\n\tNote: this isn't always necessary and I've been careful not to substitute where it wasn't necessary in meaning.\r\n2. https://github.com/koalaman/shellcheck/wiki/SC2006\r\n\t`` `command` `` → `$(command)`\r\n3. https://github.com/koalaman/shellcheck/wiki/SC2004\r\n\t`$(( $a + $b ))` → `$(( a + b ))`\r\n4. https://github.com/koalaman/shellcheck/wiki/SC2164\r\n\t`cd \"$dir\"` → `cd \"$dir\" || exit 1`\r\n5. https://github.com/koalaman/shellcheck/wiki/SC2166\r\n\t`[ check1 -o check2 ]` → `[ check1 ] || [ check2 ]`\r\n6. https://github.com/koalaman/shellcheck/wiki/SC2002\r\n\t`cat \"${file}\" | wc -c` → `< \"${file}\" wc -c`\r\n\tNote: this looks a bit uglier but works faster.\r\n\r\nII. Some special changes:\r\n1. In file `utils/common.sh`:\r\n\thttps://github.com/koalaman/shellcheck/wiki/SC2112\r\n\tThis script is interpreted by `sh`, not by `bash`, but uses the keyword `function`.\r\n\tSo I replaced `#!/usr/bin/env sh` to `#!/usr/bin/env bash`.\r\n2. After that I thought of replacing all shebangs to `#!/usr/bin/env bash` for consistency and cross-platform compatibility, especially since most of the files already use bash.\r\n3. But in cases when it was `#!/bin/sh -e` or `#!/bin/bash -eu` another problem appears:\r\n\thttps://github.com/koalaman/shellcheck/wiki/SC2096\r\n\tSo I decided to make all shebangs look uniform:\r\n\t```\r\n\t#!/usr/bin/env bash\r\n\tset -e (or set -eu) (if needed)\r\n\t```\r\n4. In file `tests/ossfuzz.sh`:\r\n\thttps://github.com/koalaman/shellcheck/wiki/SC2162\r\n\t`read i` → `read -r i`\r\n\tNote: I think that there is no need in special treatment for backslashes, but I could be wrong.\r\n5. In file `tests/do.sh.in`:\r\n\thttps://github.com/koalaman/shellcheck/wiki/SC2035\r\n\t`ls *.*cap*` → `ls -- *.*cap*`\r\n6. In file `utils/verify_dist_tarball.sh`:\r\n\thttps://github.com/koalaman/shellcheck/wiki/SC2268\r\n\t`[ \"x${TARBALL}\" = x ]` → `[ -z \"${TARBALL}\" ]`\r\n7. In file `utils/check_symbols.sh`:\r\n\thttps://github.com/koalaman/shellcheck/wiki/SC2221\r\n\t`'[ndpi_utils.o]'|'[ndpi_memory.o]'|'[roaring.o]')` → `'[ndpi_utils.o]'|'[ndpi_memory.o]')`\r\n8. In file `autogen.sh`:\r\n\thttps://github.com/koalaman/shellcheck/wiki/SC2145\r\n\t`echo \"./configure $@\"` → `echo \"./configure $*\"`\r\n\thttps://github.com/koalaman/shellcheck/wiki/SC2068\r\n\t`./configure $@` → `./configure \"$@\"`\r\n\r\nIII. `LIST6_MERGED` and `LIST_MERGED6`\r\n\tThere were typos with this variables in files `utils/aws_ip_addresses_download.sh`, `utils/aws_ip_addresses_download.sh` and `utils/microsoft_ip_addresses_download.sh` where variable `LIST6_MERGED` was defined, but `LIST_MERGED6` was removed by `rm`.\r\n\tI changed all `LIST_MERGED6` to `LIST6_MERGED`.\r\n\r\nNot all changes are absolutely necessary, but some may save you from future bugs.","shortMessageHtmlLink":"shell: reformatted, fixed inspections, typos (#2506)"}},{"before":"6a77a891a8d7581f0419235e61ada89c40a80ca7","after":"ca429669ac5b8f0101d0933ff20ee5f152c518b1","ref":"refs/heads/dev","pushedAt":"2024-07-18T15:31:07.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"smpp: fix parsing of Generic Nack message (#2496)","shortMessageHtmlLink":"smpp: fix parsing of Generic Nack message (#2496)"}},{"before":"86b67e6687d460a0eaaaa84f4f95c47aa4b95082","after":"6a77a891a8d7581f0419235e61ada89c40a80ca7","ref":"refs/heads/dev","pushedAt":"2024-07-18T14:18:12.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Add Nano (XNO) protocol support (#2508)","shortMessageHtmlLink":"Add Nano (XNO) protocol support (#2508)"}},{"before":"0a3a82680d6171a005fa944916ef551b4c3aafa7","after":"86b67e6687d460a0eaaaa84f4f95c47aa4b95082","ref":"refs/heads/dev","pushedAt":"2024-07-17T12:22:06.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"lucaderi","name":"Luca Deri","path":"/lucaderi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4493366?s=80&v=4"},"commit":{"message":"Added ClickHouse protocol","shortMessageHtmlLink":"Added ClickHouse protocol"}},{"before":"989dde1a40f9303f0e6331141f6433fd1b4ef5d9","after":"0a3a82680d6171a005fa944916ef551b4c3aafa7","ref":"refs/heads/dev","pushedAt":"2024-07-17T09:00:42.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"python: reformatted, fixed bugs (#2504)","shortMessageHtmlLink":"python: reformatted, fixed bugs (#2504)"}},{"before":"c3fff5264697bb9d107ba2f1300905753ff2f4b7","after":"989dde1a40f9303f0e6331141f6433fd1b4ef5d9","ref":"refs/heads/dev","pushedAt":"2024-07-16T15:39:55.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":".gitignore: reformatted, added patterns for IDEs, for deb packages and for test results (#2503)","shortMessageHtmlLink":".gitignore: reformatted, added patterns for IDEs, for deb packages an…"}},{"before":"996cddbd184d98f006ac7320a1afd1db373036cd","after":"c3fff5264697bb9d107ba2f1300905753ff2f4b7","ref":"refs/heads/dev","pushedAt":"2024-07-16T10:01:29.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Add HLS support (#2502)","shortMessageHtmlLink":"Add HLS support (#2502)"}},{"before":"2f66a6a3e1829b764d2acabf8745a525c68ccfb6","after":"996cddbd184d98f006ac7320a1afd1db373036cd","ref":"refs/heads/dev","pushedAt":"2024-07-15T18:43:19.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Refactor ndpi_strnstr to use ndpi_memmem (#2500)","shortMessageHtmlLink":"Refactor ndpi_strnstr to use ndpi_memmem (#2500)"}},{"before":"e059daa0f16f73f27dbdb232ede037d1a43f1fee","after":"2f66a6a3e1829b764d2acabf8745a525c68ccfb6","ref":"refs/heads/dev","pushedAt":"2024-07-15T06:35:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"ndpi_memmem: optimized, fixed bug, added tests (#2499)","shortMessageHtmlLink":"ndpi_memmem: optimized, fixed bug, added tests (#2499)"}},{"before":"f8e32bc75b3274daf3d9024449bbf0574436eda7","after":"e059daa0f16f73f27dbdb232ede037d1a43f1fee","ref":"refs/heads/dev","pushedAt":"2024-07-15T06:34:09.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Optimize performance of ndpi_strnstr() and possible bugfix (#2494)","shortMessageHtmlLink":"Optimize performance of ndpi_strnstr() and possible bugfix (#2494)"}},{"before":"c3ba65311e2cf4aba8b51cdb6800a5654ef1d060","after":"f8e32bc75b3274daf3d9024449bbf0574436eda7","ref":"refs/heads/dev","pushedAt":"2024-07-15T05:21:03.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Fixed mistake in shebang (SC1113) (#2498)","shortMessageHtmlLink":"Fixed mistake in shebang (SC1113) (#2498)"}},{"before":"456f0fd4279ae727831a80c506a343b8a9aedd90","after":"c3ba65311e2cf4aba8b51cdb6800a5654ef1d060","ref":"refs/heads/dev","pushedAt":"2024-07-12T12:22:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"fuzzing: improve coverage (#2495)\n\nFix detection of WebDAV and Gnutella (over HTTP)\r\nFix detection of z3950\r\n\r\nAdd two fuzzers to test `ndpi_memmem()` and `ndpi_strnstr()`\r\n\r\nRemove some dead code:\r\n* RTP: the same exact check is performed at the very beginning of the\r\nfunction\r\n* MQTT: use a better helper to exclude the protocol\r\n* Colletd: `ndpi_hostname_sni_set()` never fails\r\n\r\nUpdate pl7m code (fix a Use-of-uninitialized-value error)","shortMessageHtmlLink":"fuzzing: improve coverage (#2495)"}},{"before":"843e4872706b07b9e78418986d35fc86bc156d60","after":"456f0fd4279ae727831a80c506a343b8a9aedd90","ref":"refs/heads/dev","pushedAt":"2024-07-04T06:59:04.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Improve detection of Cloudflare WARP traffic (#2491)\n\nSee: #2484","shortMessageHtmlLink":"Improve detection of Cloudflare WARP traffic (#2491)"}},{"before":"e5661337d07fb1f7b2d55318bfef0929e3ca6e61","after":"843e4872706b07b9e78418986d35fc86bc156d60","ref":"refs/heads/dev","pushedAt":"2024-07-03T16:02:07.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Add infrastructure for explicit support of Fist Packet Classification (#2488)\n\nLet's start with some basic helpers and with FPC based on flow addresses.\r\n\r\nSee: #2322","shortMessageHtmlLink":"Add infrastructure for explicit support of Fist Packet Classification ("}},{"before":"1e411e98faf3eb1c427c62ed6ea0f95d3c646947","after":"e5661337d07fb1f7b2d55318bfef0929e3ca6e61","ref":"refs/heads/dev","pushedAt":"2024-07-03T14:17:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Minor fix in CI action (#2489)","shortMessageHtmlLink":"Minor fix in CI action (#2489)"}},{"before":"d42f0e6ab35ee0a196ff6a0fff76cfe8ea00afb9","after":"1e411e98faf3eb1c427c62ed6ea0f95d3c646947","ref":"refs/heads/dev","pushedAt":"2024-07-03T14:17:08.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Reduce snaplen of some traces (#2490)\n\nTo avoid the following error with some old libpcap versions:\r\n```\r\nERROR: could not open pcap file: invalid file capture length 524288, bigger than maximum of 262144\r\n```","shortMessageHtmlLink":"Reduce snaplen of some traces (#2490)"}},{"before":"dab8d3056ec4571a0343bd7fc3cdce9c4d944719","after":"d42f0e6ab35ee0a196ff6a0fff76cfe8ea00afb9","ref":"refs/heads/dev","pushedAt":"2024-07-03T14:16:54.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Add detection of Twitter bot (#2487)\n\nUpdate the global list of crawlers ips","shortMessageHtmlLink":"Add detection of Twitter bot (#2487)"}},{"before":"731b75b44c23dbd10913109338858ef9fc4d2eb6","after":"dab8d3056ec4571a0343bd7fc3cdce9c4d944719","ref":"refs/heads/dev","pushedAt":"2024-07-01T09:55:08.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"utoni","name":"Toni","path":"/utoni","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/651384?s=80&v=4"},"commit":{"message":"Make the CI faster (#2475)\n\nWithout the `-fsanitize-memory-track-origins` flag, MSAN job is ~30%\r\nfaster. Since this flag is useful only while debugging (and not to\r\nsimply discover memory issues), avoid it on the CI. Note that, by\r\ndefault it is still enabled by default.\r\n\r\nRight now, MingW runs on *every* ubuntu builds: limit it only to the\r\nstandard matrix (i.e. ubuntu 20.04, 22.04, 24.04 with default\r\nconfiguration), without any sanitizers (note that MingW doesn't support\r\n*san anyway).\r\n\r\narmhf job is by far the longest job in the CI: remove asan configuration\r\nto make it faster. Note that we already have a lot of different jobs (on\r\nx86_64) with some sanitizers, and that the other 2 jobs on arm/s390x don't\r\nhave asan support anyway.\r\nIf we really, really want a job with arm + asan we can add it as a\r\nasync/scheduled job.\r\n\r\nRemove an old workaround for ubuntu jobs\r\n\r\nAvoid installing packages needed only for the documentation\r\n\r\nAbout `check_symbols.sh` script: even if uses the compiled library/objects,\r\nit basicaly only checks if we are using, in the source code, same functions\r\nthat we shoudn't. We don't need to perform the same kind of check so\r\nmany times..","shortMessageHtmlLink":"Make the CI faster (#2475)"}},{"before":"fc334d56c4e571c831ce9ddd64f40c04ecf25fce","after":"731b75b44c23dbd10913109338858ef9fc4d2eb6","ref":"refs/heads/dev","pushedAt":"2024-07-01T07:53:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"lucaderi","name":"Luca Deri","path":"/lucaderi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4493366?s=80&v=4"},"commit":{"message":"Modified separator from , (comma) to | (pipe) as some fields such as the HTTP user agent as sometimes they contain commas and create parsing problems","shortMessageHtmlLink":"Modified separator from , (comma) to | (pipe) as some fields such as …"}},{"before":"4f05d214413d120909a84e224dd30499ef005da6","after":"fc334d56c4e571c831ce9ddd64f40c04ecf25fce","ref":"refs/heads/dev","pushedAt":"2024-07-01T06:20:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"tunnelbear: improve detection over wireguard (#2485)\n\nSee #2484","shortMessageHtmlLink":"tunnelbear: improve detection over wireguard (#2485)"}},{"before":"2009623762e3a4411f47f422d2c8e12e813c67ac","after":"4f05d214413d120909a84e224dd30499ef005da6","ref":"refs/heads/dev","pushedAt":"2024-07-01T06:20:04.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Improve detection of Twitter/X (#2482)","shortMessageHtmlLink":"Improve detection of Twitter/X (#2482)"}},{"before":"ebcea42e2b39a58c9dfa395e1992114fc0baa5ef","after":"2009623762e3a4411f47f422d2c8e12e813c67ac","ref":"refs/heads/dev","pushedAt":"2024-07-01T06:19:35.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"Add detection of OpenAI ChatGPT bots (#2481)","shortMessageHtmlLink":"Add detection of OpenAI ChatGPT bots (#2481)"}},{"before":"83e6e753af1a6123805a4777691da1f8821c01d0","after":"ebcea42e2b39a58c9dfa395e1992114fc0baa5ef","ref":"refs/heads/dev","pushedAt":"2024-06-29T16:01:05.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"IvanNardi","name":"Ivan Nardi","path":"/IvanNardi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/12729895?s=80&v=4"},"commit":{"message":"fuzz: improve fuzzers using pl7m (#2486)\n\nFor some unclear reasons, fuzzers using pl7m create huge corpus,\r\ntriggering OOM in oss-fuzz runs (where the memory RSS limit is set to\r\n2560Mb). Example:\r\n\r\n```\r\n==25340== ERROR: libFuzzer: out-of-memory (used: 2564Mb; limit: 2560Mb)\r\nTo change the out-of-memory limit use -rss_limit_mb=\r\n\r\nLive Heap Allocations: 2364004039 bytes in 133791 chunks; quarantined: 60662293 bytes in 3664 chunks; 176432 other chunks; total chunks: 313887; showing top 95% (at most 8 unique contexts)\r\n1285841683 byte(s) (54%) in 2956 allocation(s)\r\n #0 0x56f814ef4bde in __interceptor_malloc /src/llvm-project/compiler-rt/lib/asan/asan_malloc_linux.cpp:69:3\r\n #1 0x56f814e04416 in operator new(unsigned long) cxa_noexception.cpp:0\r\n #2 0x56f814de6b2d in assign /work/llvm-stage2/runtimes/runtimes-bins/compiler-rt/lib/fuzzer/libcxx_fuzzer_x86_64/include/c++/v1/vector:1443:3\r\n #3 0x56f814de6b2d in operator= /work/llvm-stage2/runtimes/runtimes-bins/compiler-rt/lib/fuzzer/libcxx_fuzzer_x86_64/include/c++/v1/vector:1412:9\r\n #4 0x56f814de6b2d in fuzzer::InputCorpus::AddToCorpus(std::__Fuzzer::vector> const&, unsigned long, bool, bool, bool, std::__Fuzzer::chrono::duration>, std::__Fuzzer::vector> const&, fuzzer::DataFlowTrace const&, fuzzer::InputInfo const*) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerCorpus.h:221:10\r\n #5 0x56f814de60e5 in fuzzer::Fuzzer::RunOne(unsigned char const*, unsigned long, bool, fuzzer::InputInfo*, bool, bool*) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerLoop.cpp:539:16\r\n #6 0x56f814de7df2 in fuzzer::Fuzzer::ReadAndExecuteSeedCorpora(std::__Fuzzer::vector>&) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerLoop.cpp:829:7\r\n #7 0x56f814de8127 in fuzzer::Fuzzer::Loop(std::__Fuzzer::vector>&) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerLoop.cpp:867:3\r\n #8 0x56f814dd6736 in fuzzer::FuzzerDriver(int*, char***, int (*)(unsigned char const*, unsigned long)) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerDriver.cpp:914:6\r\n #9 0x56f814e02c62 in main /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerMain.cpp:20:10\r\n #10 0x7fa11e2c3082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/libc-start.c:308:16\r\n\r\n1031350683 byte(s) (43%) in 2468 allocation(s)\r\n #0 0x56f814ef4bde in __interceptor_malloc /src/llvm-project/compiler-rt/lib/asan/asan_malloc_linux.cpp:69:3\r\n #1 0x56f814e04416 in operator new(unsigned long) cxa_noexception.cpp:0\r\n #2 0x56f814de6b2d in assign /work/llvm-stage2/runtimes/runtimes-bins/compiler-rt/lib/fuzzer/libcxx_fuzzer_x86_64/include/c++/v1/vector:1443:3\r\n #3 0x56f814de6b2d in operator= /work/llvm-stage2/runtimes/runtimes-bins/compiler-rt/lib/fuzzer/libcxx_fuzzer_x86_64/include/c++/v1/vector:1412:9\r\n #4 0x56f814de6b2d in fuzzer::InputCorpus::AddToCorpus(std::__Fuzzer::vector> const&, unsigned long, bool, bool, bool, std::__Fuzzer::chrono::duration>, std::__Fuzzer::vector> const&, fuzzer::DataFlowTrace const&, fuzzer::InputInfo const*) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerCorpus.h:221:10\r\n #5 0x56f814de60e5 in fuzzer::Fuzzer::RunOne(unsigned char const*, unsigned long, bool, fuzzer::InputInfo*, bool, bool*) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerLoop.cpp:539:16\r\n #6 0x56f814de7635 in fuzzer::Fuzzer::MutateAndTestOne() /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerLoop.cpp:760:19\r\n #7 0x56f814de8425 in fuzzer::Fuzzer::Loop(std::__Fuzzer::vector>&) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerLoop.cpp:905:5\r\n #8 0x56f814dd6736 in fuzzer::FuzzerDriver(int*, char***, int (*)(unsigned char const*, unsigned long)) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerDriver.cpp:914:6\r\n #9 0x56f814e02c62 in main /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerMain.cpp:20:10\r\n #10 0x7fa11e2c3082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/libc-start.c:308:16\r\n```\r\n\r\nSee: https://oss-fuzz.com/testcase-detail/4717811415449600\r\nSee: https://oss-fuzz.com/testcase-detail/6164130982068224\r\n\r\nLet's *try* the following workaround: set the parameter `-max-len` to\r\n512K, to force the engine to not genereate inputs (i.e. pcap files...)\r\nlarger than 512K. Right now the value used is 1MB, i.e the default,\r\nbecause we have file larger than 1MB in the initial seeds (i.e.\r\n`/tests/pcaps/*`).\r\n\r\nLet's hope than having smaller files lead to smaller corpus...\r\n\r\nUpdate pl7m code (fix a Use-of-uninitialized-value error)","shortMessageHtmlLink":"fuzz: improve fuzzers using pl7m (#2486)"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEhoSx9wA","startCursor":null,"endCursor":null}},"title":"Activity · ntop/nDPI"}