You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
trezor-firmware/tests/device_tests
gabrielkerekes a3d0016a2f
refactor(trezorlib/cardano): rename create_* functions
3 years ago
..
cardano refactor(trezorlib/cardano): rename create_* functions 3 years ago
.gitignore tests: move device tests to top-level 5 years ago
README.md docs: move docs to root 5 years ago
__init__.py tests: move device tests to top-level 5 years ago
data_webauthn.py tests/webauthn: Account for the increased limit on the number of resident credentials. 5 years ago
signtx.py test: Add device tests for replacement transaction flow. 4 years ago
test_autolock.py test: wait longer for autolock 3 years ago
test_basic.py chore(tests): update to kwargs usage and new btc.sign_tx API 4 years ago
test_bip32_speed.py tests: skip speed tests on T2 5 years ago
test_cancel.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_cosi.py python/cosi: improve API 4 years ago
test_debuglink.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_descriptors.py fix(python): append checksum to descriptors (#1445) 3 years ago
test_msg_applysettings.py tests: use modified protobuf classes correctly 3 years ago
test_msg_authorize_coinjoin.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_backup_device.py tests: use modified protobuf classes correctly 3 years ago
test_msg_binance_get_address.py tests: add missing licence headers 5 years ago
test_msg_binance_get_public_key.py tests: add missing licence headers 5 years ago
test_msg_binance_sign_tx.py tests: add missing licence headers 5 years ago
test_msg_change_wipe_code_t1.py test: Use long PIN values in device tests. 3 years ago
test_msg_change_wipe_code_t2.py test: Use long PIN values in device tests. 3 years ago
test_msg_changepin.py test: Use long PIN values in device tests. 3 years ago
test_msg_changepin_t2.py refactor(core): convert apps.common.request_pin to layouts 3 years ago
test_msg_cipherkeyvalue.py tests: fix relative imports 5 years ago
test_msg_eos_get_public_key.py tests: fix relative imports 5 years ago
test_msg_eos_signtx.py tests/device: fix eos delegate signing tests 5 years ago
test_msg_ethereum_getaddress.py fix(tests): fix illegal paths in device tests 4 years ago
test_msg_ethereum_getpublickey.py tests: fix relative imports 5 years ago
test_msg_ethereum_signmessage.py fix(tests): fix illegal paths in device tests 4 years ago
test_msg_ethereum_signtx.py fix(tests): fix extra ETH unknown token dialog for T1 4 years ago
test_msg_ethereum_signtx_eip155.py fix(tests): remove dropped EOSClassic test case 4 years ago
test_msg_ethereum_verifymessage.py tests: drop TrezorTest class 5 years ago
test_msg_getaddress.py test: Ensure that GetAddress and GetOwnershipId fail for multisig if user's public key is not included. 3 years ago
test_msg_getaddress_segwit.py test: Ensure that GetAddress and GetOwnershipId fail for multisig if user's public key is not included. 3 years ago
test_msg_getaddress_segwit_native.py test: Ensure that GetAddress and GetOwnershipId fail for multisig if user's public key is not included. 3 years ago
test_msg_getaddress_show.py fix: Improve wording when showing multisig XPUBS. 3 years ago
test_msg_getecdhsessionkey.py feat(core): add public_key to ECDHSessionKey 3 years ago
test_msg_getentropy.py chore(tests): update to kwargs usage and new btc.sign_tx API 4 years ago
test_msg_getownershipproof.py test: Ensure that GetAddress and GetOwnershipId fail for multisig if user's public key is not included. 3 years ago
test_msg_getpublickey.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_getpublickey_curve.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_lisk_getaddress.py fix(tests): fix illegal paths in device tests 4 years ago
test_msg_lisk_getpublickey.py fix(tests): fix illegal paths in device tests 4 years ago
test_msg_lisk_signmessage.py fix(tests): fix illegal paths in device tests 4 years ago
test_msg_lisk_signtx.py fix(tests): fix illegal paths in device tests 4 years ago
test_msg_lisk_verifymessage.py tests: drop TrezorTest class 5 years ago
test_msg_loaddevice.py tests: rename test_address to get_test_address 4 years ago
test_msg_monero_getaddress.py tests: fix relative imports 5 years ago
test_msg_monero_getwatchkey.py tests: fix relative imports 5 years ago
test_msg_nem_getaddress.py tests: fix relative imports 5 years ago
test_msg_nem_signtx_mosaics.py tests: fix relative imports 5 years ago
test_msg_nem_signtx_mosaics_t2.py tests: use modified protobuf classes correctly 3 years ago
test_msg_nem_signtx_multisig.py tests: fix relative imports 5 years ago
test_msg_nem_signtx_others.py tests: fix relative imports 5 years ago
test_msg_nem_signtx_transfers.py tests: use modified protobuf classes correctly 3 years ago
test_msg_ping.py tests: use modified protobuf classes correctly 3 years ago
test_msg_recoverydevice_bip39.py test: refactor RecoveryDevice test for TT 4 years ago
test_msg_recoverydevice_bip39_dryrun.py chore(tests): update UI fixtures as needed 3 years ago
test_msg_recoverydevice_bip39_t2.py tests: watch_layout must be explicit (fixes #1142) 4 years ago
test_msg_recoverydevice_slip39_advanced.py python/debuglink: clean out debuglink methods 4 years ago
test_msg_recoverydevice_slip39_advanced_dryrun.py common: change language field to IETF BCP 47 language tag 4 years ago
test_msg_recoverydevice_slip39_basic.py python/debuglink: clean out debuglink methods 4 years ago
test_msg_recoverydevice_slip39_basic_dryrun.py common: change language field to IETF BCP 47 language tag 4 years ago
test_msg_resetdevice_bip39.py python/debuglink: clean out debuglink methods 4 years ago
test_msg_resetdevice_bip39_skipbackup.py python/debuglink: clean out debuglink methods 4 years ago
test_msg_resetdevice_bip39_t2.py refactor(core): convert parts of apps.management to layouts 3 years ago
test_msg_resetdevice_slip39_advanced.py tests: use modified protobuf classes correctly 3 years ago
test_msg_resetdevice_slip39_basic.py tests: use modified protobuf classes correctly 3 years ago
test_msg_ripple_get_address.py common: change language field to IETF BCP 47 language tag 4 years ago
test_msg_ripple_sign_tx.py tests: streamline TrezorFailure exception usage 4 years ago
test_msg_sd_protect.py tests: make {needs,no}_backup flags available in test suite 5 years ago
test_msg_signidentity.py tests: fix relative imports 5 years ago
test_msg_signmessage.py feat(core): implement pagination for sign/verify 3 years ago
test_msg_signtx.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_signtx_amount_unit.py tests: add device tests for SignTx with amount_unit 3 years ago
test_msg_signtx_bcash.py fix(tests): fix illegal paths in device tests 4 years ago
test_msg_signtx_bgold.py fix(tests): fix illegal paths in device tests 4 years ago
test_msg_signtx_dash.py tests: Fix device tests for streamimg prev_tx after confirmation. 4 years ago
test_msg_signtx_decred.py multi: Add decred staking. 3 years ago
test_msg_signtx_external.py style: apply black 20.8b1 4 years ago
test_msg_signtx_grs.py chore(tests): update to kwargs usage and new btc.sign_tx API 4 years ago
test_msg_signtx_invalid_path.py tests: Fix device tests for streamimg prev_tx after confirmation. 4 years ago
test_msg_signtx_komodo.py chore(tests): update to kwargs usage and new btc.sign_tx API 4 years ago
test_msg_signtx_mixed_inputs.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_signtx_peercoin.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_signtx_prevhash.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_signtx_replacement.py test: Add device test for replacement transaction with OP_RETURN output. 3 years ago
test_msg_signtx_segwit.py style: apply black 20.8b1 4 years ago
test_msg_signtx_segwit_native.py tests: Fix device tests for streamimg prev_tx after confirmation. 4 years ago
test_msg_signtx_zcash.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_stellar_get_address.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_msg_stellar_sign_transaction.py chore(tests): update to kwargs usage and new btc.sign_tx API 4 years ago
test_msg_tezos_getaddress.py tests: drop TrezorTest class 5 years ago
test_msg_tezos_getpublickey.py tests: drop TrezorTest class 5 years ago
test_msg_tezos_sign_tx.py core/tezos: support the new protocol update (005-BABYLON) 5 years ago
test_msg_verifymessage.py tests: drop TrezorTest class 5 years ago
test_msg_verifymessage_segwit.py tests: drop TrezorTest class 5 years ago
test_msg_verifymessage_segwit_native.py tests: drop TrezorTest class 5 years ago
test_msg_webauthn.py tests: fix test_msg_webauthn on-device 4 years ago
test_msg_wipedevice.py test: wait longer for autolock 3 years ago
test_multisig.py fix(tests): fix illegal paths in device tests 4 years ago
test_multisig_change.py tests: Fix device tests for streamimg prev_tx after confirmation. 4 years ago
test_op_return.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_passphrase_slip39_advanced.py tests: use new trezorlib locking/sessioning API where appropriate 4 years ago
test_passphrase_slip39_basic.py tests: rename test_address to get_test_address 4 years ago
test_protect_call.py chore(tests): update to kwargs usage and new btc.sign_tx API 4 years ago
test_protection_levels.py chore(tests): update to kwargs usage and new btc.sign_tx API 4 years ago
test_reset_backup.py tests: use modified protobuf classes correctly 3 years ago
test_reset_recovery_bip39.py tests: use modified protobuf classes correctly 3 years ago
test_reset_recovery_slip39_advanced.py tests: use modified protobuf classes correctly 3 years ago
test_reset_recovery_slip39_basic.py tests: use modified protobuf classes correctly 3 years ago
test_sdcard.py tests: watch_layout must be explicit (fixes #1142) 4 years ago
test_session.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_session_id_and_passphrase.py tests: get rid of skip_ui (fixes #1409) 3 years ago
test_u2f_counter.py python: rename webauthn and u2f to fido 5 years ago

README.md

Running device tests

1. Running the full test suite

Note: You need Poetry, as mentioned in the core's documentation section.

In the trezor-firmware checkout, in the root of the monorepo, install the environment:

poetry install

And run the automated tests:

poetry run make -C core test_emu

2. Running tests manually

Install the poetry environment as outlined above. Then switch to a shell inside the environment:

poetry shell

If you want to test against the emulator, run it in a separate terminal:

./core/emu.py

Now you can run the test suite with pytest from the root directory:

pytest tests/device_tests

Useful Tips

The tests are randomized using the pytest-random-order plugin. The random seed is printed in the header of the tests output, in case you need to run the tests in the same order.

If you only want to run a particular test, pick it with -k <keyword> or -m <marker>:

pytest -k nem      # only runs tests that have "nem" in the name
pytest -m stellar  # only runs tests marked with @pytest.mark.stellar

If you want to see debugging information and protocol dumps, run with -v.

If you would like to interact with the device (i.e. press the buttons yourself), just prefix pytest with INTERACT=1:

INTERACT=1 pytest tests/device_tests

3. Using markers

When you're developing a new currency, you should mark all tests that belong to that currency. For example, if your currency is called NewCoin, your device tests should have the following marker:

@pytest.mark.newcoin

This marker must be registered in REGISTERED_MARKERS file.

If you wish to run a test only on TT, mark it with @pytest.mark.skip_t1. If the test should only run on T1, mark it with @pytest.mark.skip_t2. You must not use both on the same test.

Extended testing and debugging

Building for debugging (Emulator only)

Build the debuggable unix binary so you can attach the gdb or lldb. This removes optimizations and reduces address space randomizaiton.

make build_unix_debug

The final executable is significantly slower due to ASAN(Address Sanitizer) integration. If you wan't to catch some memory errors use this.

time ASAN_OPTIONS=verbosity=1:detect_invalid_pointer_pairs=1:strict_init_order=true:strict_string_checks=true TREZOR_PROFILE="" poetry run make test_emu

Coverage (Emulator only)

Get the Python code coverage report.

If you want to get HTML/console summary output you need to install the coverage.py tool.

pip3 install coverage

Run the tests with coverage output.

make build_unix && make coverage