This repo is extended based on the original SmartBugs:
- We added a tool Securify2 and its parsing script.
- We modified the config of Slither, to enable its latest version.
- We added runtime config for some tools to make them work properly, which is saved in
site-configfolder. - To run tools on large-scale contracts, we added a folder
sbdto save the file paths of contracts. Ansbdfile (smartbugs dataset) contains a list of files to analyse, one per line. - We added a default Solidity version for analysis, which contributes to the analysis of contracts with no
pragma soliditystatement. You can change it as you like.
SmartBugs is an extensible platform with a uniform interface to tools that analyse blockchain programs for weaknesses and other properties.
-
20 supported tools, 3 modes for analysing Solidity source code, deployment bytecode, and runtime code.
-
A modular approach to integrating analysers. All it takes to add a new tool is a Docker image encapsulating the tool and a few lines in a config file. To make the output accessible in a standardised format, add a small Python script.
-
Parallel, randomised execution of the tasks for the optimal use of resources when performing a bulk analysis.
-
Standardised output format. Scripts parse and normalise the output of the tools to allow for an automated analysis of the results across tools.
-
Automatic download of an appropriate Solidity compiler matching the contract under analysis, and injection into the Docker image.
-
Output of results in SARIF format, for integration into Github workflows.
| version | Solidity | bytecode | runtime code | |
|---|---|---|---|---|
| ConFuzzius | #4315fb7 v0.0.1 | ✔️ | ||
| Conkas | #4e0f256 | ✔️ | ✔️ | |
| Ethainter | ✔️ | |||
| eThor | 2023 | ✔️ | ||
| HoneyBadger | #ff30c9a | ✔️ | ✔️ | |
| MadMax | #6e9a6e9 | ✔️ | ||
| Maian | #4bab09a | ✔️ | ✔️ | ✔️ |
| Manticore | 0.3.7 | ✔️ | ||
| Mythril | 0.24.7 | ✔️ | ✔️ | ✔️ |
| Osiris | #d1ecc37 | ✔️ | ✔️ | |
| Oyente | #480e725 | ✔️ | ✔️ | |
| Pakala | #c84ef38 v1.1.10 | ✔️ | ||
| Securify | ✔️ | ✔️ | ||
| Semgrep | #c3a9f40 | ✔️ | ||
| sFuzz | #48934c0 (2019-03-01) | ✔️ | ||
| Slither | 0.10.0 | ✔️ | ||
| Smartcheck | ✔️ | |||
| Solhint | 3.3.8 | ✔️ | ||
| teEther | #04adf56 | ✔️ | ||
| Vandal | #d2b0043 | ✔️ | ||
| Securify2 | 2.0 | ✔️ |
- Linux, MacOS or Windows; other Unixes probably as well
- Docker
- Python3 (version 3.6 and above, 3.10+ recommended)
-
Make sure that the user running SmartBugs is allowed to interact with the Docker daemon, by adding the user to the
dockergroup:sudo usermod -a -G docker $USERFor adding another user, replace
$USERby the respective user-id. The group membership becomes active with the next log-in. -
Clone SmartBugs's repository:
git clone https://github.com/smartbugs/smartbugs
-
Install Python dependencies in a virtual environment:
cd smartbugs install/setup-venv.sh -
Optionally, add the executables to the command search path, e.g. by adding links to
$HOME/bin.ln -s "`pwd`/smartbugs" "$HOME/bin/smartbugs" ln -s "`pwd`/reparse" "$HOME/bin/reparse" ln -s "`pwd`/results2csv" "$HOME/bin/results2csv"
The command
which smartbugsshould now display the path to the command.
See our wiki page on running SmartBugs in Windows.
SmartBugs provides a command-line interface. Run it without arguments for a short description. For details, see the wiki.
./smartbugs
usage: smartbugs [-c FILE] [-t TOOL [TOOL ...]] [-f PATTERN [PATTERN ...]] [--main] [--runtime]
[--processes N] [--timeout N] [--cpu-quota N] [--mem-limit MEM]
[--runid ID] [--results DIR] [--log FILE] [--overwrite] [--json] [--sarif] [--quiet]
[--version] [-h]
...For details, see SmartBugs' wiki.
Example: To analyse the Solidity files in the samples directory with Mythril, use the command
./smartbugs -t mythril -f samples/*.sol --processes 2 --mem-limit 4g --timeout 600The options tell SmartBugs to run two processes in parallel, with a memory limit of 4GB and max. 10 minutes computation time per task.
By default, the results are placed in the local directory results.
reparse can be used to parse analysis results and extract relevant information, without rerunning the analysis.
This may be useful either when you did not specify the option --json or --sarif during analysis, or when you want to parse old analysis results with an updated parser.
./reparse
usage: reparse [-h] [--sarif] [--processes N] [-v] DIR [DIR ...]results2csv generates a csv file from the results, suitable e.g. for a database.
./results2csv
usage: results2csv [-h] [-p] [-v] [-f FIELD [FIELD ...]] [-x FIELD [FIELD ...]] DIR [DIR ...]The following commands analyse SimpleDAO.sol with all available tools and write the parsed output to results.csv.
reparse is necessary in this example, since smartbugs is called without the options --json and --sarif, so SmartBugs doesn't parse during the analysis.
results2csv collects the outputs in the folder results and writes for each analysed contract one line of comma-separated values to standard output (redirected to results.csv).
The option -p tells results2csv to format the lists of findings, errors etc. as Postgres arrays; without the option, the csv file is suitable for spreadsheet programs.
./smartbugs -t all -f samples/SimpleDAO.sol
./reparse results
./results2csv -p results > results.csv-
10 contracts: The folder
samplescontains a few selected Solidity source files with the corresponding deployment and runtime bytecodes, to test the installation. -
143 contracts: SB Curated is a curated dataset of vulnerable Solidity smart contracts.
-
3103/2529/2473 contracts as source/deployment/runtime code: Consolidated Ground Truth (CGT) is a unified and consolidated ground truth with 20,455 manually checked assessments (positive and negative) of security-related properties.
-
47,398 contracts: SmartBugs Wild Dataset is a repository with smart contracts extracted from the Ethereum network.
-
248,328 contracts: Skelcodes is a repository of deployment and runtime codes, with an indication if the source code is available on Etherscan. By the way the contracts were selected, they faithfully represent, in most respects, the 45 million contracts successfully deployed up to block 14,000,000.
If you use SmartBugs or any of the datasets above, you may want to cite one of the following papers.
@inproceedings{diAngeloEtAl2023ASE,
title = {{SmartBugs} 2.0: An Execution Framework for Weakness Detection in {Ethereum} Smart Contracts},
author={di Angelo, Monika and Durieux, Thomas and Ferreira, Jo{\~a}o F. and Salzer, Gernot},
booktitle={Proceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023)},
year={2023},
note={to appear}
}
@inproceedings{FerreiraEtAl2020ASE,
title={{SmartBugs}: A Framework to Analyze {Solidity} Smart Contracts},
author={Ferreira, Jo{\~a}o F and Cruz, Pedro and Durieux, Thomas and Abreu, Rui},
booktitle={Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering},
pages={1349--1352},
year={2020}
}
- SmartBugs Wild Dataset: Durieux, T., Ferreira, J.F., Abreu, R. and Cruz, P.: "Empirical review of automated analysis tools on 47,587 Ethereum smart contracts:, in Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering (ICSE 2020), pages 530-541, 2020. The paper analyzes the contracts in the wild dataset using SmartBugs v1.0. The results are available in a separate repository.
@inproceedings{DurieuxEtAl2020ICSE,
title={Empirical Review of Automated Analysis Tools on 47,587 {Ethereum} Smart Contracts},
author={Durieux, Thomas and Ferreira, Jo{\~a}o F. and Abreu, Rui and Cruz, Pedro},
booktitle={Proceedings of the ACM/IEEE 42nd International conference on software engineering},
pages={530--541},
year={2020}
}
@article{diAngeloEtAl2023EMSE,
title = {Evolution of Automated Weakness Detection in {Ethereum} Bytecode: a Comprehensive Study},
author={di Angelo, Monika and Durieux, Thomas and Ferreira, Jo{\~a}o F. and Salzer, Gernot},
journal={Empirical Software Engineering},
year={2023),
note={to appear}
}
You can show your appreciation for the project and support future development by donating.
🙌 ETH Donations: 0xA4FBA2908162646197aca90b84B095BE4D16Ae53 🙌
The license applies to all files in the repository,
with the exception of the smart contracts in the samples folder.
The files there were obtained from Etherscan
and retain their original licenses.