1
0
mirror of https://github.com/trezor/trezor-firmware.git synced 2024-12-24 15:28:10 +00:00
trezor-firmware/tests/device_tests
2020-09-03 14:56:27 +02:00
..
cardano tests: move fixtures to common directory, start with Cardano 2020-09-01 16:14:41 +02:00
__init__.py tests: move device tests to top-level 2019-08-12 12:57:25 +02:00
.gitignore tests: move device tests to top-level 2019-08-12 12:57:25 +02:00
data_webauthn.py tests/webauthn: Account for the increased limit on the number of resident credentials. 2019-11-01 16:14:16 +01:00
README.md docs: move docs to root 2019-12-06 12:24:20 +00:00
signtx.py tests: simplify code of test_msg_signtx 2020-04-25 18:27:29 +02:00
test_autolock.py core: raise error on auto-lock value out of range 2020-07-22 21:38:42 +02:00
test_basic.py python: clarify session and feature management API 2020-08-05 16:45:56 +02:00
test_bip32_speed.py tests: skip speed tests on T2 2019-11-01 13:59:12 +00:00
test_cancel.py tests: update UI test fixtures 2020-06-04 16:18:46 +02:00
test_cosi.py python/cosi: improve API 2020-01-20 17:32:58 +01:00
test_debuglink.py tests: clear session before each testcase 2020-08-28 15:37:06 +02:00
test_msg_applysettings.py core: fix boot loop after uploading invalid homescreen (#1205) 2020-08-21 12:00:42 +02:00
test_msg_authorize_coinjoin.py Revert "core: remove ownership messages from the public api for now" 2020-09-03 14:56:27 +02:00
test_msg_backup_device.py tests: clear session before each testcase 2020-08-28 15:37:06 +02:00
test_msg_binance_get_address.py tests: add missing licence headers 2019-09-10 13:48:51 +02:00
test_msg_binance_get_public_key.py tests: add missing licence headers 2019-09-10 13:48:51 +02:00
test_msg_binance_sign_tx.py tests: add missing licence headers 2019-09-10 13:48:51 +02:00
test_msg_change_wipe_code_t1.py tests: clear session before each testcase 2020-08-28 15:37:06 +02:00
test_msg_change_wipe_code_t2.py tests: fix test suite for softlock 2020-06-04 16:18:46 +02:00
test_msg_changepin_t2.py tests: use new trezorlib locking/sessioning API where appropriate 2020-08-28 15:37:06 +02:00
test_msg_changepin.py tests: use new trezorlib locking/sessioning API where appropriate 2020-08-28 15:37:06 +02:00
test_msg_cipherkeyvalue.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_eos_get_public_key.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_eos_signtx.py tests/device: fix eos delegate signing tests 2019-11-11 12:20:32 +01:00
test_msg_ethereum_getaddress.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_ethereum_getpublickey.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_ethereum_signmessage.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_ethereum_signtx_eip155.py tests: fix flake errors 2020-07-03 17:33:59 +02:00
test_msg_ethereum_signtx.py common: divisibility -> decimals 2019-12-09 17:43:47 +01:00
test_msg_ethereum_verifymessage.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_getaddress_segwit_native.py tests: update test vectors to use correct paths 2020-05-15 14:08:29 +02:00
test_msg_getaddress_segwit.py tests: update test vectors to use correct paths 2020-05-15 14:08:29 +02:00
test_msg_getaddress_show.py tests: watch_layout must be explicit (fixes #1142) 2020-07-29 11:50:47 +02:00
test_msg_getaddress.py core: increase address length limit to accomodate CRW (fixes #1139) 2020-08-07 12:45:43 +02:00
test_msg_getecdhsessionkey.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_getentropy.py tests: move device tests to top-level 2019-08-12 12:57:25 +02:00
test_msg_getownershipproof.py Revert "core: remove ownership messages from the public api for now" 2020-09-03 14:56:27 +02:00
test_msg_getpublickey_curve.py core: relax path checks on GetPublicKey 2020-05-27 06:58:30 +00:00
test_msg_getpublickey.py core: relax path checks on GetPublicKey 2020-05-27 06:58:30 +00:00
test_msg_lisk_getaddress.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_lisk_getpublickey.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_lisk_signmessage.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_lisk_signtx.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_lisk_verifymessage.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_loaddevice.py tests: rename test_address to get_test_address 2020-06-04 16:18:46 +02:00
test_msg_monero_getaddress.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_monero_getwatchkey.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_getaddress.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_signtx_mosaics_t2.py debug: Add left and right swipe direction to DebugLinkDecision message and unify terminology around swipe direction. 2019-10-10 14:56:49 +02:00
test_msg_nem_signtx_mosaics.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_signtx_multisig.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_signtx_others.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_nem_signtx_transfers.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_ping.py tests: fix test suite for softlock 2020-06-04 16:18:46 +02:00
test_msg_recoverydevice_bip39_dryrun.py tests: watch_layout must be explicit (fixes #1142) 2020-07-29 11:50:47 +02:00
test_msg_recoverydevice_bip39_t2.py tests: watch_layout must be explicit (fixes #1142) 2020-07-29 11:50:47 +02:00
test_msg_recoverydevice_bip39.py test: refactor RecoveryDevice test for TT 2020-06-04 16:18:46 +02:00
test_msg_recoverydevice_slip39_advanced_dryrun.py common: change language field to IETF BCP 47 language tag 2019-12-08 11:27:10 +01:00
test_msg_recoverydevice_slip39_advanced.py python/debuglink: clean out debuglink methods 2020-06-04 16:18:46 +02:00
test_msg_recoverydevice_slip39_basic_dryrun.py common: change language field to IETF BCP 47 language tag 2019-12-08 11:27:10 +01:00
test_msg_recoverydevice_slip39_basic.py python/debuglink: clean out debuglink methods 2020-06-04 16:18:46 +02:00
test_msg_resetdevice_bip39_skipbackup.py python/debuglink: clean out debuglink methods 2020-06-04 16:18:46 +02:00
test_msg_resetdevice_bip39_t2.py core: use ButtonRequestType.PinEntry for PIN entry 2020-06-04 16:18:46 +02:00
test_msg_resetdevice_bip39.py python/debuglink: clean out debuglink methods 2020-06-04 16:18:46 +02:00
test_msg_resetdevice_slip39_advanced.py tests/ui: reseed each ui test before running it 2020-01-07 12:38:12 +00:00
test_msg_resetdevice_slip39_basic.py tests: test reset device also with another strengths 2020-03-13 10:12:50 +00:00
test_msg_ripple_get_address.py common: change language field to IETF BCP 47 language tag 2019-12-08 11:27:10 +01:00
test_msg_ripple_sign_tx.py tests: streamline TrezorFailure exception usage 2020-03-26 11:30:06 +01:00
test_msg_sd_protect.py tests: make {needs,no}_backup flags available in test suite 2019-11-13 16:48:35 +01:00
test_msg_signidentity.py tests: fix relative imports 2019-09-12 14:41:05 +02:00
test_msg_signmessage.py tests: update test vectors to use correct paths 2020-05-15 14:08:29 +02:00
test_msg_signtx_bcash.py tests/sign_tx: Add device tests for transactions with external inputs in bgold, bcash and zcash. 2020-07-03 11:17:19 +02:00
test_msg_signtx_bgold.py tests: fix flake errors 2020-07-03 17:33:59 +02:00
test_msg_signtx_dash.py tests: convert signtx tests to use request_* shortcuts for readability 2020-04-25 18:27:29 +02:00
test_msg_signtx_decred.py core/bitcoin: drop decred_script_version 2020-05-21 19:14:39 +02:00
test_msg_signtx_external.py tests/sign_tx: Add device tests for transactions with external inputs. 2020-07-03 11:17:19 +02:00
test_msg_signtx_grs.py tests: add request_meta queries (needed for transaction streaming) 2020-05-24 14:36:37 +00:00
test_msg_signtx_invalid_path.py tests: add tests for invalid paths 2020-08-21 11:49:03 +02:00
test_msg_signtx_komodo.py legacy/signing: Ask user to confirm custom nLockTime. 2020-08-21 21:30:15 +02:00
test_msg_signtx_mixed_inputs.py tests/signing: fix mixed inputs test 2020-05-24 14:36:38 +00:00
test_msg_signtx_peercoin.py Merge branch 'release/2020-04' 2020-04-15 15:00:23 +02:00
test_msg_signtx_prevhash.py core: add hard limit for transaction fees 2020-08-17 16:12:33 +02:00
test_msg_signtx_segwit_native.py tests: add request_meta queries (needed for transaction streaming) 2020-05-24 14:36:37 +00:00
test_msg_signtx_segwit.py core: add hard limit for transaction fees 2020-08-17 16:12:33 +02:00
test_msg_signtx_zcash.py core: drop zcash v3 tx signing support 2020-07-30 15:14:18 +02:00
test_msg_signtx.py tests: Add device test for nLockTime in Bitcoin. 2020-08-21 21:30:15 +02:00
test_msg_stellar_get_address.py core/keychain: differentiate error message for ed25519 derivation 2020-07-24 16:37:58 +02:00
test_msg_stellar_sign_transaction.py core/stellar: add screen for timebounds 2019-12-05 14:31:28 +00:00
test_msg_tezos_getaddress.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_tezos_getpublickey.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_tezos_sign_tx.py core/tezos: support the new protocol update (005-BABYLON) 2019-10-23 17:53:10 +02:00
test_msg_verifymessage_segwit_native.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_verifymessage_segwit.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_verifymessage.py tests: drop TrezorTest class 2019-09-12 14:41:05 +02:00
test_msg_webauthn.py tests: fix test_msg_webauthn on-device 2020-08-05 13:47:35 +02:00
test_msg_wipedevice.py tests: fix test suite for softlock 2020-06-04 16:18:46 +02:00
test_multisig_change.py tests: convert signtx tests to use request_* shortcuts for readability 2020-04-25 18:27:29 +02:00
test_multisig.py tests: add request_meta queries (needed for transaction streaming) 2020-05-24 14:36:37 +00:00
test_op_return.py tests: convert signtx tests to use request_* shortcuts for readability 2020-04-25 18:27:29 +02:00
test_passphrase_slip39_advanced.py tests: use new trezorlib locking/sessioning API where appropriate 2020-08-28 15:37:06 +02:00
test_passphrase_slip39_basic.py tests: rename test_address to get_test_address 2020-06-04 16:18:46 +02:00
test_protect_call.py tests: disable PIN detection, all PIN uses must be explicit 2020-06-04 16:18:46 +02:00
test_protection_levels.py legacy, core: rename Features.pin_cached to unlocked and unify 2020-06-19 21:26:36 +02:00
test_reset_backup.py python: clarify session and feature management API 2020-08-05 16:45:56 +02:00
test_reset_recovery_bip39.py tests/ui: reseed each ui test before running it 2020-01-07 12:38:12 +00:00
test_reset_recovery_slip39_advanced.py tests/ui: reseed each ui test before running it 2020-01-07 12:38:12 +00:00
test_reset_recovery_slip39_basic.py tests: introduce UI tests for core 2020-01-03 14:28:27 +00:00
test_sdcard.py tests: watch_layout must be explicit (fixes #1142) 2020-07-29 11:50:47 +02:00
test_session_id_and_passphrase.py tests: update device tests with added ButtonRequests where appropriate 2020-08-21 21:30:15 +02:00
test_session.py Merge remote-tracking branch 'origin/release/2020-09' 2020-09-03 13:17:23 +02:00
test_u2f_counter.py python: rename webauthn and u2f to fido 2019-11-18 11:50:07 +01:00

Running device tests

1. Running the full test suite

Note: You need Pipenv, as mentioned in the core's documentation section.

In the trezor-firmware checkout, in the root of the monorepo, install the environment:

pipenv sync

And run the automated tests:

pipenv run make -C core test_emu

2. Running tests manually

Install the pipenv environment as outlined above. Then switch to a shell inside the environment:

pipenv shell

If you want to test against the emulator, run it in a separate terminal:

./core/emu.py

Now you can run the test suite with pytest from the root directory:

pytest tests/device_tests

Useful Tips

The tests are randomized using the pytest-random-order plugin. The random seed is printed in the header of the tests output, in case you need to run the tests in the same order.

If you only want to run a particular test, pick it with -k <keyword> or -m <marker>:

pytest -k nem      # only runs tests that have "nem" in the name
pytest -m stellar  # only runs tests marked with @pytest.mark.stellar

If you want to see debugging information and protocol dumps, run with -v.

If you would like to interact with the device (i.e. press the buttons yourself), just prefix pytest with INTERACT=1:

INTERACT=1 pytest tests/device_tests

3. Using markers

When you're developing a new currency, you should mark all tests that belong to that currency. For example, if your currency is called NewCoin, your device tests should have the following marker:

@pytest.mark.newcoin

This marker must be registered in REGISTERED_MARKERS file.

If you wish to run a test only on TT, mark it with @pytest.mark.skip_t1. If the test should only run on T1, mark it with @pytest.mark.skip_t2. You must not use both on the same test.

Extended testing and debugging

Building for debugging (Emulator only)

Build the debuggable unix binary so you can attach the gdb or lldb. This removes optimizations and reduces address space randomizaiton.

make build_unix_debug

The final executable is significantly slower due to ASAN(Address Sanitizer) integration. If you wan't to catch some memory errors use this.

time ASAN_OPTIONS=verbosity=1:detect_invalid_pointer_pairs=1:strict_init_order=true:strict_string_checks=true TREZOR_PROFILE="" pipenv run make test_emu

Coverage (Emulator only)

Get the Python code coverage report.

If you want to get HTML/console summary output you need to install the coverage.py tool.

pip3 install coverage

Run the tests with coverage output.

make build_unix && make coverage