/*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \mainpage Introduction This manual explains the scope and the usage of the Software Pack for \b CMSIS-Driver \b Validation. CMSIS-Driver are standard peripheral API interfaces that connect microcontroller peripherals with middleware or the user application. The Software Pack for CMSIS-Driver validation provides: - Configurable validation tests for several CMSIS-Driver interfaces - Example projects that show the usage of the CMSIS-Driver validation The CMSIS-Driver Validation tests and verifies: - \b API \b interface \b interaction using the driver capabilities as well as valid and invalid parameters. - \b Data \b communication with various transfer sizes and communication parameters (i.e. baudrate). - \b Loopback \b communication (for some interfaces) for testing the underlying hardware. - \b Transfer \b speed of the data communication with time measurement of data transfers. The CMSIS-Driver Validation requires CMSIS-RTOS or CMSIS-RTOS2 functionality and can be used to verify the setup and configuration of the CMSIS-Driver interfaces in a user system. It is also used to validate implementation of a CMSIS-Driver interface. The diagram below is an overview of the configuration for CMSIS-Driver validation. \image html DVSuite.png This manual contains the following chapters: - \ref test_setup - Describes the general setup of the CMSIS-Driver validation test and how to generate test output. - \ref test_results - Explains how to interpret the test results from loopback tests. - \ref examples - Contains information of several example projects including the required hardware setup. - \ref resource_requirements - Lists memory and CMSIS-RTOS requirements. - Reference - explains the individual tests for the various CMSIS-Driver interfaces. The Software Pack for CMSIS-Driver validation current tests the following interfaces: - \ref can_funcs - Controller Area Network (CAN) peripheral. - \ref eth_funcs - Interface to Ethernet MAC and PHY peripheral. - \ref i2c_funcs - Inter-Integrated Circuit (I2C) multi-master serial single-ended bus interface driver. - \ref mci_funcs - Memory card interface for SD/MMC memory. - \ref spi_funcs - Serial Peripheral Interface (SPI) driver. - \ref usart_funcs - Universal Synchronous and Asynchronous Receiver/Transmitter (USART) interface driver. - \ref usbd_funcs - Universal Serial Bus (USB) Device interface driver. - \ref usbh_funcs - Universal Serial Bus (USB) Host interface driver. - \ref wifi_funcs - WiFi (Wireless Fidelity Interface) module driver. This manual assumes that you are familiar with MDK. Refer to MDK Version 5 - Getting Started for additional information.
Revision History ----------------
Version Description
V1.4.0 - Updated conditions to support all Cortex-M devices - Introduced test groups (each driver is organized in a group) - Improved XSL for XML display - Updated all examples - Removed example for Atmel board - WiFi Driver Testing: Added SockServer application for PC running Microsoft Windows - WiFi Driver Testing: Added upstream and downstream bandwidth testing - WiFi Driver Testing: Added example for Inventek ISM43362 WiFi Driver testing on STMicroelectronics B-L475E-IOT01A1 board - WiFi Driver Testing: Added example for Inventek ISM43362 WiFi Driver testing using ISMART43362-E WiFi shield mounted on NXP LPCXpresso55S69 board - WiFi Driver Testing: Added examples for Espressif ESP8266 and ESP32 WiFi Driver testing with NXP MIMXRT1064-EVK board - WiFi Driver Testing: Added example for WIZnet WizFi360 WiFi Driver testing with NXP MIMXRT1064-EVK board
V1.3.0 - Added WiFi tests
V1.2.0 - Added CMSIS-RTOS2 and Arm Compiler 6 compatibility
V1.1.0 - Added USB Host, CAN and Ethernet Precision Time Protocol tests
V1.0.0 - Initial release for CMSIS-Driver API V2.0
*/ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page test_setup Test Setup \section step1 Step 1: Create an MDK project with your target microcontroller device \section step2 Step 2: Add required software components For proper operation, add the following software components in the Manage Run-Time Environment window: - CMSIS Driver Validation:Framework - CMSIS Driver Validation:driver, driver interfaces to be tested - CMSIS Driver:driver, driver implementations to be tested - CMSIS:RTOS2 (API):Keil RTX5 - Compiler:I/O:STDOUT, variant \b ITM (if your hardware does not support ITM select \b User or \b EVR) - Resolve any unresolved component dependecies \section step3 Step 3: Add main.c Right-click Source Group 1... and select Add New Item to Group. Select User Code Template and choose the \b main file from Device:Startup or CMSIS-RTOS2:Keil RTX5. Add this include: \code include "cmsis_dv.h" \endcode In the main function, after kernel initialization, create the \c cmsis_dv thread: \code osThreadNew(cmsis_dv, NULL, NULL); \endcode to run all tests that you have chosen in the next step. \section step4 Step 4: Configure DV_Config.h Open \c DV_Config.h under the CMSIS Driver Validation group in the Project window. \image html dv_config_h.png "Configuration File DV_Config.h" Common Test Settings The common test settings help you to choose the output format of the test, buffer sizes and buffer content that should be used for the send, receive, and transfer tests: - The \b Print \b Output \b Format lets you select if you wish to create the output as plain text or as styled XML. - \b Buffer \b sizes lets you select the buffer sizes that are used for data transfer. This setting has a direct impact on required \ref step6 "heap". - You can specify also the Buffer size for baudrate test. For USART you can set the Percentual tolerance for baudrate test and for SPI the Percentual trigger for bus speed test. Depending on the device \ref step7 "configuration", for example when DMA is not used, the transfers may have larger overhead which is more significant for higher bus speeds. The transfer overhead is reduced for larger transfer buffer sizes. - Select your preferred Buffer pattern Driver-specific Settings Every interface has specific settings that can be changed in the according section: - You need to specify the driver instance number (Driver_interface#) used for the test. This is especially important for microcontroller devices that have multiple peripherals of the same kind. - Some drivers can have additional baudrate or timing settings. - Select all driver tests that you wish to use. Note that all tests can run independently from each other. You do not need to specify a certain order. \note For more information on additional settings and the different driver test cases, check the Reference section. \note For WiFi driver validation some settings depend on the test environment and they need to be set properly, for details please refer to \ref wifi_config section. \section step5 Step 5: Configure Keil RTX5 Open \b RTX_Config.h and set: - Default Thread stack size [bytes] to \a 2048 - Global Dynamic Memory size [bytes] to \a 8192 (Note 1) \note Note 1: This setting is only necessary for WiFi driver testing, for other tests default setting of 4096 is sufficient. \section step6 Step 6: Configure Heap Depending on the buffer sizes that you have chosen in \ref step4 "Step 4", you need to add more heap. Depending on how heap is configured in your system open your startup_device.s file from the \b Device group in the \b Project window or use a linker script to adjust the heap setting. Click on the Configuration Wizard view. Increase the heap size: - for the validation framework add 1024 bytes. - double the largest buffer size you have set in the configuration file and add this as well. Refer to the \ref resource_requirements section for a calculation example. \section step7 Step 7: Configure the Device Depending on your device, you might have different pin/hardware configuration options. Usually, you can configure the device using the \c RTE_Device.h file from the \b Device group. Enable all interfaces you wish to use in the tests and make all necessary pin-out changes required by your actual board layout (consult the board schematics). The pre-built \ref examples "examples" are already configured for the underlying hardware. For a robust test with good coverage, implement various targets with different settings: - \b Enable/disable the \b DMA controller of your device - Set different \b buffer \b sizes in \ref step4 "DV_Config.h" - Select different compiler \b optimization \b levels in the C/C++ tab of the Options for Target dialog. \section step8 Step 8: Setup Additional Hardware For the interfaces that support loopback testing: \ref eth_funcs "Ethernet", \ref spi_funcs "SPI", and \ref usart_funcs "USART", connect the following pins on your target hardware together (refer to the hardware schematics): - Ethernet: RX+ and TX+, RX- and TX- - SPI: MISO and MOSI - USART: RX and TX For WiFi specific hardware requirements please refer to \ref wifi_requirements. \section step9 Step 9: Download and Run the Project In the Options for Target dialog, under debug settings, if you use ITM as standard output channel ensure that \b Trace and ITM port \token{0} are enabled and that the correct clock frequency is set: \image html target_dialog.png "ITM Channel setting" Build, load and run the project. The output is displayed in the Debug (printf) Viewer window: \verbatim CMSIS-Driver ETH Test Report Nov 15 2019 15:25:59 TEST 01: ETH_MAC_GetCapabilities PASSED TEST 02: ETH_MAC_Initialization PASSED TEST 03: ETH_MAC_PowerControl DV_ETH.c (163): [WARNING] Low power is not supported PASSED TEST 04: ETH_MAC_SetBusSpeed DV_ETH.c (197): [WARNING] Link speed 1G is not supported PASSED TEST 05: ETH_MAC_Config_Mode PASSED TEST 06: ETH_MAC_Config_CommonParams PASSED TEST 07: ETH_PHY_Initialization PASSED TEST 08: ETH_PHY_PowerControl DV_ETH.c (300): [WARNING] Low power is not supported PASSED TEST 09: ETH_PHY_Config PASSED TEST 10: ETH_Loopback_Transfer PASSED TEST 11: ETH_PHY_CheckInvalidInit NOT EXECUTED TEST 12: ETH_MAC_CheckInvalidInit NOT EXECUTED Test Summary: 12 Tests, 10 Passed, 0 Failed. Test Result: PASSED \endverbatim If you see warnings during loopback transfer tests, please read the section \ref test_results which gives you more information on how to interpret the results. */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page test_results Reading Test Results The tests \ref SPI_Loopback_CheckBusSpeed and \ref USART_Loopback_CheckBaudrate may issue warnings when using the default settings (especially loopback communication tests for SPI and USART): \verbatim CMSIS-Driver SPI Test Report Nov 15 2019 15:35:11 TEST 01: SPI_GetCapabilities PASSED TEST 02: SPI_Initialization PASSED TEST 03: SPI_PowerControl DV_SPI.c (244): [WARNING] Low power is not supported PASSED TEST 04: SPI_Config_PolarityPhase PASSED TEST 05: SPI_Config_DataBits PASSED TEST 06: SPI_Config_BitOrder DV_SPI.c (315): [WARNING] Bit order LSB_MSB is not supported PASSED TEST 07: SPI_Config_SSMode DV_SPI.c (343): [WARNING] Slave select MASTER_HW_INPUT is not supported PASSED TEST 08: SPI_Config_BusSpeed PASSED TEST 09: SPI_Config_CommonParams PASSED TEST 10: SPI_Send PASSED TEST 11: SPI_Receive PASSED TEST 12: SPI_Loopback_CheckBusSpeed DV_SPI.c (525): [WARNING] At 25000kHz: measured time is 2.437125 x expected time PASSED TEST 13: SPI_Loopback_Transfer PASSED TEST 14: SPI_CheckInvalidInit NOT EXECUTED \endverbatim The measured time is depending mainly on two factors: \b DMA and \b software \b overhead. If you are not using \b DMA for data transfer, an interrupt is generated, in worst case, for every transferred byte. The interrupt handling overhead for each byte can produce 10 times slower transfer than DMA. DMA will transfer the data without overhead. Thus, only bus speed/baudrate tests with DMA enabled should be considered for optimization. In case DMA cannot be used (because no DMA channel is left to be used for example), the user needs to be aware that the data rates will decrease significantly. The \b software \b overhead is introduced by the way the measurement is done. When the measurement is started a system tick value is stored and then the transfer is set up and started. The software then needs to determine when the transfer has ended and calculate required time difference by using previously stored system ticks and current system ticks. Usually, the software overhead is a constant number of CPU cycles. The total amount of time required for the software overhead depends on the actual CPU that is used and on the optimization level used during build. \n Increasing the Buffer size for baudrate test reduces the software overhead effect. The following calculation example explains why. \b Calculation \b Example SPI bus speed = 25 Mbps - Buffer size for baudrate tests = 512 byte (default value, equals 512 * 8 bit) - Actual bus speed = 18 Mbps (read from driver) - Expected time to transfer data = 227 µs (512 * 8 bit/18 Mbps) - Measured time = 245 µs = 227 µs + 18 µs (coming from a software overhead) - This results in a measured/expected time ratio of 1.08 which will lead to a warning Using a buffer size of 8192 bytes in the example above will reduce the software overhead to less than 1% (which will issue no warning anymore). */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page examples Examples This Software Pack contains a set or pre-built examples that show how to use the validation suite together with real hardware. The following example projects are available. Use Pack Installer to copy them to your machine: - \subpage examples_xmc4500_relax - \subpage examples_mcbstm32f200 - \subpage examples_mcbstm32f400 - \subpage examples_b_l475e_iot01a1 - \subpage examples_stm32f746g - \subpage examples_ismart43362_e \anchor example_targets Targets ------- All projects contain two targets: - Create Report: Test results and statistics are printed to the file \c TestReport\TestReport.xml. Open the file in a web browser of your choice. \note Passed Status means that test case has passed sucessfully. \note Passed Status means that tests case has passed but there were some warnings (More details can be used to see the details). \note Not executed Status means test case did not check any assertions. \note Failed Status means test case has failed (More details can be used to see the details). - \b Debug: Results and statistics are printed to the Debug (printf) Viewer window through the standard output. */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page examples_xmc4500_relax Infineon XMC4500 Relax Kit Software Setup -------------- Using Pack Installer install latest Infineon::XMC4000_DFP pack and copy the example project CMSIS-Driver Validation (XMC4500 Relax Lite Kit) to your machine. -# Choose one of the available \ref example_targets and build the project. -# If you wish to test the loopback mode for some of the interfaces, refer to the next section for proper board configuration. -# Run the test on the target hardware using the on-board JLink-Lite debug adapter. Hardware Setup -------------- The following picture shows the necessary external loopback connections for the Infineon XMC4500 Relax Kit evaluation board: - UART2: \b P0.4 (UART2_RX) and \b P0.5 (UART2_TX) (Header X2) - SPI0: \b P5.0 (SPI0_MOSI) and \b P5.1 (SPI0_MISO) (Header X2) - For Ethernet use a loopback plug as described in \ref eth_loopback "Loopback Communication Setup". \image html xmc4500.png "Connections for Loop Back Communication Tests on Infineon XMC4500 Relax Kit" */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page examples_mcbstm32f200 Keil MCBSTM32F200 Software Setup -------------- Using Pack Installer install latest Keil::STM32F2xx_DFP pack and copy the example project CMSIS-Driver Validation (MCBSTM32F200) to your machine. -# Choose one of the available \ref example_targets and build the project. -# If you wish to test the loopback mode for some of the interfaces, refer to the next section for proper board configuration. -# Run the test on the target hardware. \note To communicate with the development board, a debug adapter from the ULINK family is required. Hardware Setup -------------- The following picture shows the necessary external loopback connections for the Keil MCBSTM32F400 evaluation board: - SPI2: \b PB14 (SPI2_MISO) and \b PB15 (SPI2_MOSI) - USART1: \b PB6 (USART1_TX) and \b PB7 (USART1_RX) - For Ethernet use a loopback plug as described in \ref eth_loopback "Loopback Communication Setup". \image html mcbstm32f400.png "Connections for Loop Back Communication Tests on Keil MCBSTM32F200" */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page examples_mcbstm32f400 Keil MCBSTM32F400 Software Setup -------------- Using Pack Installer install latest Keil::STM32F4xx_DFP pack and copy the example project CMSIS-Driver Validation (MCBSTM32F400) to your machine. -# Choose one of the available \ref example_targets and build the project. -# If you wish to test the loopback mode for some of the interfaces, refer to the next section for proper board configuration. -# Run the test on the target hardware. \note To communicate with the development board, a debug adapter from the ULINK family is required. Hardware Setup -------------- The following picture shows the necessary external loopback connections for the Keil MCBSTM32F400 evaluation board: - SPI2: \b PB14 (SPI2_MISO) and \b PB15 (SPI2_MOSI) - USART1: \b PB6 (USART1_TX) and \b PB7 (USART1_RX) - For Ethernet use a loopback plug as described in \ref eth_loopback "Loopback Communication Setup". \image html mcbstm32f400.png "Connections for Loop Back Communication Tests on Keil MCBSTM32F400" */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page examples_b_l475e_iot01a1 STMicroelectronics B-L475E-IOT01A1 Software Setup -------------- Using Pack Installer install latest Keil::STM32L4xx_DFP pack and copy the example project CMSIS-Driver WiFi Inventek ISM43362 Validation (B-L475E-IOT01A1) to your machine. -# Choose one of the available \ref example_targets and build the project. -# Run the test on the target hardware using the on-board ST-Link/V2. This example is prepared for testing of the WiFi driver and it requires \ref wifi_requirements, as well as, propper configuration described in \ref wifi_config. For details on WiFi driver tests please refer to \ref wifi_funcs. \image html b-l475e-iot01a.png "STMicroelectronics B-L475E-IOT01A1 board" */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page examples_ismart43362_e ISMART43362-E WiFi Shield with NXP LPCXpresso55S69 Software Setup -------------- Using Pack Installer install latest NXP::LPC55S69_DFP and NXP::LPCXpresso55S69_EVK packs and copy the example project CMSIS-Driver WiFi Inventek ISM43362 Validation (LPCXpresso55S69) to your machine. -# Choose one of the available \ref example_targets and build the project. -# Run the test on the target hardware. \note To communicate with the development board, a debug adapter ULINKplus is required. This example is prepared for testing of the WiFi driver and it requires \ref wifi_requirements, as well as, propper configuration described in \ref wifi_config. For details on WiFi driver tests please refer to \ref wifi_funcs. \image html LPCXpresso55S69.png "NXP LPCXpresso55S69 with ISMART43362-E WiFi shield attached" */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page examples_stm32f746g STMicroelectronics STM32F746G-Discovery Software Setup -------------- Using Pack Installer install latest Keil::STM32F7xx_DFP pack and copy the example project CMSIS-Driver Validation (STM32F746G-Discovery) to your machine. -# Choose one of the available \ref example_targets and build the project. -# If you wish to test the loopback mode for some of the interfaces, refer to the next section for proper board configuration. -# Run the test on the target hardware using the on-board ST-Link/V2. Hardware Setup -------------- The following picture shows the necessary external loopback connections for the STM32F746G-Discovery evaluation board: - SPI2: \b D12 (SPI2_MISO) and \b D11 (SPI2_MOSI) - USART6: \b D1 (USART6_TX) and \b D0 (USART6_RX) - For Ethernet use a loopback plug as described in \ref eth_loopback "Loopback Communication Setup". \image html stm32f746G-disco.png "Connections for Loop Back Communication Tests on STM32F746G-Discovery" */ /*=======0=========1=========2=========3=========4=========5=========6=========7=========8=========9=========0=========1====*/ /** \page resource_requirements Resource Requirements \section heap_req Heap Requirements Heap is used by memory allocation functions. It is configured in the startup_device.s file located under the \b Device component class. Additional memory is allocated for the validation framework and for the buffers that are used in the driver tests. For the validation framework add 1024 bytes of heap. Then, double the amount of the largest buffer size specified in the \ref step4 "DV_Config.h" file and add this as well. | Option (under section Heap Configuration) | Increase Value by | :---------------------------------------------------------------- | :---------------------- | Heap Size (in Bytes) | + (1024 + 2 x maximum buffer size) \b Calculation \b Example Let's assume that the default heap size in your device's startup file is \c 0x400 (which is 1024 bytes). Add 1024 for the framework and for example another 2048 bytes if you are using the default \b Buffer \b Size of 512 bytes but you have set the Buffer size for baudrate tests to 1024 bytes. This computes to a total heap of 3584 bytes which is equivalent to \c 0xE00. Set this number in the startup file. \section rtos2_req CMSIS-RTOS2 Requirements The thread requirements need to be reflected in the CMSIS-RTOS2 configuration. Refer to the CMSIS-RTOS2 Reference for further details. For CMSIS-RTOS2 RTX5, thread requirements are configured in the RTX_Config.h file located under the \b CMSIS component class:
Option (under section Thread Configuration) Set Value to
Default Thread stack size [bytes] 2048
Global Dynamic Memory size [bytes] (Note 1) 8192
\note Note 1: This setting is only necessary for WiFi driver testing, for other tests default setting of 4096 is sufficient. \section rtos_req CMSIS-RTOS Requirements Instead of CMSIS-RTOS2 you can use CMSIS-RTOS. In this case the \c main thread is implicitly created. For proper operation, you need to add a certain amount of thread stack size to the \c main thread. The thread requirements need to be reflected in the CMSIS-RTOS configuration. Refer to the CMSIS-RTOS Reference for further details. For CMSIS-RTOS RTX, thread requirements are configured in the RTX_Conf_CM.c file located under the \b CMSIS component class:
Option (under section Thread Configuration) Set Value to
Default Thread stack size [bytes] 2048
Main Thread stack size [bytes] 2048
\note Do not forget to set the correct RTOS Kernel Timer input clock frequency [Hz] otherwise the tests will not run properly on the device. \note Only WiFi tests create one additional thread for socket testing and usually WiFi drivers have a thread for processing messages. */