1
0
mirror of https://github.com/trezor/trezor-firmware.git synced 2024-12-22 22:38:08 +00:00
trezor-firmware/tests/device_tests
Frederik Bolding 38fa9197ca feat(core,python): support for Ethereum EIP1559 transactions
Initial EIP1559 implementation

Fix a few small issues

Progress on Python lib implementation and firmware

Fix RLP length

Start fixing tests

Fix legacy transactions

Simplify API and logic

Add EIP1559 tests

Fix access list formatting

Fix UI visiblity issue

Fix commented out code

fix: correct linting issues

Fix access_list protobuf formatting

Remove unneeded code

Remove dead code

Check tx_type bounds for EIP 2718

Reduce code duplication

Prefer eip2718_type over re-using tx_type

Add more tests

Simplify format_access_list

Simplify sign_tx slightly

Change Access List format and add logic to encode it

Fix a bunch of small PR comments

Fix a linting issue

Move tests out of class and regenerate

Remove copy-pasted comments

Add access list to CLI

Simplify _parse_access_list_item

Fix small mistakes following rebase

Fix linting

Refactor to use a separate message for EIP 1559 tx

Simplify changed legacy code

Fix a few small PR comments

Fix linting

fix(legacy): recognize SignTxEIP1559 on legacy build

Fix PR comments
2021-08-10 11:00:29 +02:00
..
cardano fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
__init__.py tests: move device tests to top-level 2019-08-12 12:57:25 +02:00
.gitignore tests: move device tests to top-level 2019-08-12 12:57:25 +02:00
data_webauthn.py tests/webauthn: Account for the increased limit on the number of resident credentials. 2019-11-01 16:14:16 +01:00
README.md docs: move docs to root 2019-12-06 12:24:20 +00:00
signtx.py test: Add device tests for replacement transaction flow. 2020-10-23 15:07:15 +02:00
test_autolock.py test: wait longer for autolock 2021-02-23 14:31:04 +01:00
test_basic.py chore(tests): update to kwargs usage and new btc.sign_tx API 2020-09-23 16:00:10 +02:00
test_bip32_speed.py tests: skip speed tests on T2 2019-11-01 13:59:12 +00:00
test_cancel.py fix(core): properly respond to USB events while on a paginated screen 2021-07-20 12:59:26 +02:00
test_cosi.py python/cosi: improve API 2020-01-20 17:32:58 +01:00
test_debuglink.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_descriptors.py fix(python): append checksum to descriptors (#1445) 2021-02-05 17:46:02 +01:00
test_msg_applysettings.py test(device): Test safety checks on T1. 2021-05-24 17:47:43 +02:00
test_msg_authorize_coinjoin.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_msg_backup_device.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_msg_binance_get_address.py refactor(core): convert apps.binance to layouts 2021-06-23 11:51:18 +02:00
test_msg_binance_get_public_key.py refactor(core): convert apps.binance to layouts 2021-06-23 11:51:18 +02:00
test_msg_binance_sign_tx.py tests: add missing licence headers 2019-09-10 13:48:51 +02:00
test_msg_change_wipe_code_t1.py test: Use long PIN values in device tests. 2021-03-25 14:24:41 +01:00
test_msg_change_wipe_code_t2.py test: Use long PIN values in device tests. 2021-03-25 14:24:41 +01:00
test_msg_changepin_t2.py refactor(core): convert apps.common.request_pin to layouts 2021-03-30 22:34:01 +02:00
test_msg_changepin.py test: Use long PIN values in device tests. 2021-03-25 14:24:41 +01:00
test_msg_cipherkeyvalue.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_eos_get_public_key.py refactor(core): convert apps.eos to layouts 2021-06-23 11:51:18 +02:00
test_msg_eos_signtx.py chore(tests): adapt device tests to paging information ButtonRequests 2021-06-22 11:25:12 +02:00
test_msg_ethereum_getaddress.py fix(tests): fix illegal paths in device tests 2020-11-05 14:30:11 +01:00
test_msg_ethereum_getpublickey.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_ethereum_signmessage.py fix(tests): fix illegal paths in device tests 2020-11-05 14:30:11 +01:00
test_msg_ethereum_signtx_eip155.py fix(tests): remove dropped EOSClassic test case 2020-11-20 18:55:35 +01:00
test_msg_ethereum_signtx_eip1559.py feat(core,python): support for Ethereum EIP1559 transactions 2021-08-10 11:00:29 +02:00
test_msg_ethereum_signtx.py fix(tests): fix extra ETH unknown token dialog for T1 2020-11-20 18:55:35 +01:00
test_msg_ethereum_verifymessage.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_getaddress_segwit_native.py test(device): Test safety checks on T1. 2021-05-24 17:47:43 +02:00
test_msg_getaddress_segwit.py test: Ensure that GetAddress and GetOwnershipId fail for multisig if user's public key is not included. 2021-02-11 10:26:44 +01:00
test_msg_getaddress_show.py docs(core): replace Purpose48 with BIP-48 2021-08-06 12:50:42 +02:00
test_msg_getaddress.py test(device): Test safety checks on T1. 2021-05-24 17:47:43 +02:00
test_msg_getecdhsessionkey.py feat(core): add public_key to ECDHSessionKey 2021-03-08 15:59:00 +01:00
test_msg_getentropy.py chore(tests): update to kwargs usage and new btc.sign_tx API 2020-09-23 16:00:10 +02:00
test_msg_getownershipproof.py test: Ensure that GetAddress and GetOwnershipId fail for multisig if user's public key is not included. 2021-02-11 10:26:44 +01:00
test_msg_getpublickey_curve.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_msg_getpublickey.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_msg_lisk_getaddress.py fix(tests): fix illegal paths in device tests 2020-11-05 14:30:11 +01:00
test_msg_lisk_getpublickey.py fix(tests): fix illegal paths in device tests 2020-11-05 14:30:11 +01:00
test_msg_lisk_signmessage.py fix(tests): fix illegal paths in device tests 2020-11-05 14:30:11 +01:00
test_msg_lisk_signtx.py fix(tests): fix illegal paths in device tests 2020-11-05 14:30:11 +01:00
test_msg_lisk_verifymessage.py chore(tests): adapt device tests to paging information ButtonRequests 2021-06-22 11:25:12 +02:00
test_msg_loaddevice.py tests: rename test_address to get_test_address 2020-06-04 16:18:46 +02:00
test_msg_monero_getaddress.py refactor(core): convert most of apps.monero to layouts 2021-06-23 11:51:18 +02:00
test_msg_monero_getwatchkey.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_getaddress.py refactor(core): convert apps.nem to layouts 2021-06-23 11:51:18 +02:00
test_msg_nem_signtx_mosaics_t2.py chore(tests): adapt device tests to paging information ButtonRequests 2021-06-22 11:25:12 +02:00
test_msg_nem_signtx_mosaics.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_signtx_multisig.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_signtx_others.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_signtx_transfers.py tests: use modified protobuf classes correctly 2021-02-10 10:56:52 +01:00
test_msg_ping.py tests: use modified protobuf classes correctly 2021-02-10 10:56:52 +01:00
test_msg_recoverydevice_bip39_dryrun.py chore(tests): adapt device tests to paging information ButtonRequests 2021-06-22 11:25:12 +02:00
test_msg_recoverydevice_bip39_t2.py tests: watch_layout must be explicit (fixes #1142) 2020-07-29 11:50:47 +02:00
test_msg_recoverydevice_bip39.py chore(tests): drop unused debug pieces 2021-08-04 10:58:59 +02:00
test_msg_recoverydevice_slip39_advanced_dryrun.py common: change language field to IETF BCP 47 language tag 2019-12-08 11:27:10 +01:00
test_msg_recoverydevice_slip39_advanced.py chore(tests): adapt device tests to paging information ButtonRequests 2021-06-22 11:25:12 +02:00
test_msg_recoverydevice_slip39_basic_dryrun.py common: change language field to IETF BCP 47 language tag 2019-12-08 11:27:10 +01:00
test_msg_recoverydevice_slip39_basic.py chore(tests): adapt device tests to paging information ButtonRequests 2021-06-22 11:25:12 +02:00
test_msg_resetdevice_bip39_skipbackup.py python/debuglink: clean out debuglink methods 2020-06-04 16:18:46 +02:00
test_msg_resetdevice_bip39_t2.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_msg_resetdevice_bip39.py python/debuglink: clean out debuglink methods 2020-06-04 16:18:46 +02:00
test_msg_resetdevice_slip39_advanced.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_msg_resetdevice_slip39_basic.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_msg_ripple_get_address.py common: change language field to IETF BCP 47 language tag 2019-12-08 11:27:10 +01:00
test_msg_ripple_sign_tx.py tests: streamline TrezorFailure exception usage 2020-03-26 11:30:06 +01:00
test_msg_sd_protect.py tests: make {needs,no}_backup flags available in test suite 2019-11-13 16:48:35 +01:00
test_msg_signidentity.py chore(tests): drop unused debug pieces 2021-08-04 10:58:59 +02:00
test_msg_signmessage.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_msg_signtx_amount_unit.py tests: add device tests for SignTx with amount_unit 2021-01-22 14:07:36 +01:00
test_msg_signtx_bcash.py fix(tests): set_filter must be used in with-block 2021-08-04 10:58:59 +02:00
test_msg_signtx_bgold.py fix(tests): set_filter must be used in with-block 2021-08-04 10:58:59 +02:00
test_msg_signtx_dash.py tests: Fix device tests for streamimg prev_tx after confirmation. 2020-09-04 14:36:39 +02:00
test_msg_signtx_decred.py multi: Add decred staking. 2021-03-17 12:16:08 +01:00
test_msg_signtx_external.py style: apply black 20.8b1 2020-09-29 11:30:40 +02:00
test_msg_signtx_grs.py chore(tests): update to kwargs usage and new btc.sign_tx API 2020-09-23 16:00:10 +02:00
test_msg_signtx_invalid_path.py test(device): Test safety checks on T1. 2021-05-24 17:47:43 +02:00
test_msg_signtx_komodo.py chore(tests): update to kwargs usage and new btc.sign_tx API 2020-09-23 16:00:10 +02:00
test_msg_signtx_mixed_inputs.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_msg_signtx_peercoin.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_msg_signtx_prevhash.py fix(tests): Adjust the expected error message 2021-06-08 09:55:19 +02:00
test_msg_signtx_replacement.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_msg_signtx_segwit_native.py tests: Fix device tests for streamimg prev_tx after confirmation. 2020-09-04 14:36:39 +02:00
test_msg_signtx_segwit.py fix(tests): set_filter must be used in with-block 2021-08-04 10:58:59 +02:00
test_msg_signtx_zcash.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_msg_signtx.py fix(tests): set_filter must be used in with-block 2021-08-04 10:58:59 +02:00
test_msg_stellar_get_address.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_msg_stellar_sign_transaction.py fix(legacy,core): Fix operation source account encoding in Stellar. 2021-07-13 17:24:16 +02:00
test_msg_tezos_getaddress.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_tezos_getpublickey.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_tezos_sign_tx.py chore(tests): adapt device tests to paging information ButtonRequests 2021-06-22 11:25:12 +02:00
test_msg_verifymessage_segwit_native.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_verifymessage_segwit.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_verifymessage.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_webauthn.py tests: fix test_msg_webauthn on-device 2020-08-05 13:47:35 +02:00
test_msg_wipedevice.py test: wait longer for autolock 2021-02-23 14:31:04 +01:00
test_multisig_change.py fix(tests): Fix device tests after having disabled testnet for BIP-45 paths. 2021-06-30 18:25:58 +02:00
test_multisig.py fix(tests): set_filter must be used in with-block 2021-08-04 10:58:59 +02:00
test_nonstandard_paths.py fix(legacy): Allow known non-standard paths in GetAddress and SignTx. 2021-06-30 18:25:58 +02:00
test_op_return.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_passphrase_slip39_advanced.py tests: use new trezorlib locking/sessioning API where appropriate 2020-08-28 15:37:06 +02:00
test_passphrase_slip39_basic.py tests: rename test_address to get_test_address 2020-06-04 16:18:46 +02:00
test_protect_call.py chore(tests): update to kwargs usage and new btc.sign_tx API 2020-09-23 16:00:10 +02:00
test_protection_levels.py chore(tests): update to kwargs usage and new btc.sign_tx API 2020-09-23 16:00:10 +02:00
test_reset_backup.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_reset_recovery_bip39.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_reset_recovery_slip39_advanced.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_reset_recovery_slip39_basic.py fix(tests): auto-swipe by using only ButtonRequest.pages 2021-07-12 00:39:58 +02:00
test_sdcard.py tests: watch_layout must be explicit (fixes #1142) 2020-07-29 11:50:47 +02:00
test_session_id_and_passphrase.py chore(tests): fix deprecation warnings 2021-05-06 13:14:21 +02:00
test_session.py tests: get rid of skip_ui (fixes #1409) 2021-02-05 10:44:09 +01:00
test_u2f_counter.py fix(core): exclude get/set U2F counter from BITCOIN_ONLY 2021-06-08 09:55:19 +02:00

Running device tests

1. Running the full test suite

Note: You need Poetry, as mentioned in the core's documentation section.

In the trezor-firmware checkout, in the root of the monorepo, install the environment:

poetry install

And run the automated tests:

poetry run make -C core test_emu

2. Running tests manually

Install the poetry environment as outlined above. Then switch to a shell inside the environment:

poetry shell

If you want to test against the emulator, run it in a separate terminal:

./core/emu.py

Now you can run the test suite with pytest from the root directory:

pytest tests/device_tests

Useful Tips

The tests are randomized using the pytest-random-order plugin. The random seed is printed in the header of the tests output, in case you need to run the tests in the same order.

If you only want to run a particular test, pick it with -k <keyword> or -m <marker>:

pytest -k nem      # only runs tests that have "nem" in the name
pytest -m stellar  # only runs tests marked with @pytest.mark.stellar

If you want to see debugging information and protocol dumps, run with -v.

If you would like to interact with the device (i.e. press the buttons yourself), just prefix pytest with INTERACT=1:

INTERACT=1 pytest tests/device_tests

3. Using markers

When you're developing a new currency, you should mark all tests that belong to that currency. For example, if your currency is called NewCoin, your device tests should have the following marker:

@pytest.mark.newcoin

This marker must be registered in REGISTERED_MARKERS file.

If you wish to run a test only on TT, mark it with @pytest.mark.skip_t1. If the test should only run on T1, mark it with @pytest.mark.skip_t2. You must not use both on the same test.

Extended testing and debugging

Building for debugging (Emulator only)

Build the debuggable unix binary so you can attach the gdb or lldb. This removes optimizations and reduces address space randomizaiton.

make build_unix_debug

The final executable is significantly slower due to ASAN(Address Sanitizer) integration. If you wan't to catch some memory errors use this.

time ASAN_OPTIONS=verbosity=1:detect_invalid_pointer_pairs=1:strict_init_order=true:strict_string_checks=true TREZOR_PROFILE="" poetry run make test_emu

Coverage (Emulator only)

Get the Python code coverage report.

If you want to get HTML/console summary output you need to install the coverage.py tool.

pip3 install coverage

Run the tests with coverage output.

make build_unix && make coverage