This version (25 May 2022 10:09) was approved by Laszlo Nagy.The Previously approved version (25 May 2022 10:01) is available.
Table of Contents
ADQUADMXFE1EBZ HDL Reference Design
Functional Overview
The AD-QUADMXFE1-EBZ reference design is a processor based (e.g. Microblaze) embedded system. The design consists from a receive and a transmit chain.
The receive chain transports the captured samples from ADC to the system memory (DDR). Before transferring the data to DDR the samples are stored in a buffer implemented on block rams from the FPGA fabric (util_adc_fifo). The size of the buffer is sized to store up to M x 16k samples per converter if a single channel is selected or 16k samples per converter if all channels are selected.
The transmit chain transports samples from the system memory to the DAC devices. Before streaming out the data to the DAC through the JESD link the samples first are loaded into a buffer (util_dac_fifo) which will cyclically stream the samples at the tx_device_clk data rate.
All cores from the receive and transmit chains are programmable through an AXI-Lite interface.
The transmit and receive chains must operate at the same data rates having a common device_clk.
HDL source code
Reference design location:
Supported Carriers
- VCU118 FMC+ Slot
Software support
Building the HDL
To build the HDL, first clone the repo and check out the dev_quad_mxfe_revc branch. Change the directory to the projects/ad_quadmxfe1_ebz folder and run the make command as specified below. For information on how to change branches and more detailed steps of the build process, refer to this page: build. This generates the .bit file used to load the platform.
The Vivado version 2020.1 is used to build the HDL for the Quad MxFE project
Other examples / documentation
A few examples of how to modify the IP are listed here: tips. More documentation on the HDL is here: hdl
Building The Corresponding Linux Image
To build the Linux image, the buildroot process is preferred. The instructions are primarily based around a Linux environment. To get started, follow the directions here: buildroot. Once cloned there is a list of device trees (from here: linux/tree/master/arch/microblaze/boot/dts). A new device tree can be specified during the build process if needed.
See the “Building for Microblaze - simpleImage.<board>” Instructions as a reference.
- Change directory into the buildroot directory.
- make microblaze_adi_defconfig
- make BR2_LINUX_KERNEL_INTREE_DTS_NAME=vcu118_quad_ad9081
This will generate the .strip file that will be loaded onto the platform using the .tcl script.
Build Image By Hand
Alternatively, the linux image can be built by hand by following these steps: microblaze. This method is similar to the buildroot path, but allows for a separate specification of Root file system and other environmental variables.
Block design
The block design of the system is parameterizable, allowing the user to fit the design to their needs by changing JESD parameters or link mode to match the desired configuration of the converter parts. The configuration of parameters is done at build time through setting system variables or through modifying the project tcl files.
Block design parameters
Parameter description:
JESD_MODE : used link layer encoder mode
64B66B - 64b66b link layer defined in JESD 204C, uses Xilinx IP as Physical layer
8B10B - 8b10b link layer defined in JESD 204B, uses ADI IP as Physical layer
RX_RATE : line rate of the Rx link ( MxFE to FPGA ) used in 64B66B mode
TX_RATE : line rate of the Tx link ( FPGA to MxFE ) used in 64B66B mode
REF_CLK_RATE : frequency of reference clock in MHz used in 64B66B mode
[RX/TX]_PLL_SEL : used in 64B66B mode,
0 - CPLL for lane rates 4-12.5 Gbps and integer sub-multiples
1 - QPLL0 for lane rates 19.6–32.75 Gbps and integer sub-multiples (e.g. 9.8–16.375;)
2 - QPLL1 for lane rates 16.0–26.0 Gbps and integer sub-multiple (e.g. 8.0–13.0;)
For detail see JESD204 PHY v4.0 pg198-jesd204-phy.pdf and ug578-ultrascale-gty-transceivers.pdf
[RX/TX]_JESD_M : number of converters per link
[RX/TX]_JESD_L : number of lanes per link
[RX/TX]_JESD_NP : number of bits per sample, only 16 is supported
[RX/TX]_NUM_LINKS : number of links, matches number of MxFE devices
RX_KS_PER_CHANNEL : number of samples that can be stored for each channel in a block RAM for a contiguous capture
TX_KS_PER_CHANNEL : number of samples that can be loaded for each channel in a block RAM for a contiguous cyclic streaming
DAC_TPL_XBAR_ENABLE : enable NxN crossbar functionality at the transport layer, where N is the number of channels
Supported build configurations
| default | B_9_10 | C_10_11 | C_11_4 | C_23_25 | C_29_24 | C_12_13 | C_3_2 | |
|---|---|---|---|---|---|---|---|---|
| JESD_MODE | 64B66B | 8B10B | 64B66B | 64B66B | 64B66B | 64B66B | 64B66B | 64B66B |
| RX_RATE | 16.5 | N/A | 16.5 | 16.5 | 24.75 | 24.75 | 24.75 | 16.5 |
| TX_RATE | 16.5 | N/A | 16.5 | 16.5 | 24.75 | 24.75 | 24.75 | 16.5 |
| RX_PLL_SEL | 2 | N/A | 1 | 1 | 1 | |||
| TX_PLL_SEL | 2 | N/A | 1 | 1 | 1 | |||
| REF_CLK_RATE | 250 | N/A | 250 | 250 | 250 | 250 | 250 | 250 |
| RX_JESD_M | 8 | 8 | 4 | 8 | 4 | 8 | 2 | 4 |
| RX_JESD_L | 2 | 4 | 4 | 2 | 4 | 4 | 4 | 1 |
| RX_JESD_S | 1 | 1 | 1 | 1 | 2 | 1 | 1 | 1 |
| RX_JESD_NP | 16 | 12 | 12 | |||||
| RX_NUM_LINKS | 4 | |||||||
| TX_JESD_M | 16 | 8 | 4 | 16 | 4 | 8 | 2 | 8 |
| TX_JESD_L | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 2 |
| TX_JESD_S | 1 | 1 | 1 | 1 | 2 | 1 | 1 | 1 |
| TX_JESD_NP | 16 | 12 | 12 | |||||
| TX_NUM_LINKS | 4 | |||||||
| RX_KS_PER_CHANNEL | 32 | 64 | 32 | 16 | 16 | 64 | 16 | |
| TX_KS_PER_CHANNEL | 16 | 16 | 16 | 16 | 16 | 64 | 16 | |
| DAC_TPL_XBAR_ENABLE | 0 |
If parameter not specified the default value applies.
Configuration names are encoded with <B_C>_<TX_MODE>_<RX_MODE> where <B_C> is B for 8B/10B (a.k.a. 204B) and C for 64B66B (a.k.a. 204C)
| Configuration name | Linux device tree |
|---|---|
| B_9_10 | vcu118_quad_ad9081_204b_txmode_9_rxmode_10_revc.dts |
| C_10_11 | vcu118_quad_ad9081_204c_txmode_10_rxmode_11_revc.dts |
| C_11_4 | vcu118_quad_ad9081_204c_txmode_11_rxmode_4_revc.dts |
| C_23_25 | vcu118_quad_ad9081_204c_txmode_23_rxmode_25_revc.dts |
| C_29_24 | vcu118_quad_ad9081_204c_txmode_29_rxmode_24_revc.dts |
| C_12_13 | vcu118_quad_ad9082_204c_txmode_12_rxmode_13.dts |
| C_3_2 | vcu118_quad_ad9082_204c_txmode_3_rxmode_2.dts |
Testcase M8, L4
The 4 MxFE Rx and Tx links are connected to a single transceiver block having 16 Rx and 16 Tx lanes in total. The 4 Rx links merge into a single receive link layer and a single transport layer having a compatible configuration to L=4;M=8;F=4;S=1 Similarly to Rx, the single transmit link layer and transport layer handles the 4 Tx links.
Build instructions:
The project must be built with the following parameters:
make JESD_MODE=8B10B RX_JESD_M=8 RX_JESD_L=4 TX_JESD_M=8 TX_JESD_L=4
The Rx links (ADC Path) operate with the following parameters:
- Rx Deframer parameters: L=16, M=32, F=4, S=1, N’=16, N = 16 (equivalent to Quick Config 0x0A)
- Dual link : No
- DEVICE_CLK – 250 MHz (Lane Rate/40)
- REF_CLK – 500 MHz (Lane Rate/20)
- JESD204B Lane Rate – 10 Gbps
- QPLL0 or CPLL
The Tx links (DAC Path) operate with the following parameters:
- Tx Framer parameters: L=16, M=32, F=4, S=1, N’=16, N = 16 (equivalent to Quick Config 0x09)
- Dual link : No
- DEVICE_CLK – 250 MHz (Lane Rate/40)
- REF_CLK – 500 MHz (Lane Rate/20)
- JESD204B Lane Rate – 10 Gbps
- QPLL0 or CPLL
Testcase DAC M16,L4 ADC M8,L2
The 4 MxFE Rx and Tx links are connected to a single transceiver block having 8 Rx and 16 Tx lanes in total. The 4 Rx links merge into a single receive link layer and a single transport layer having a compatible configuration to L=2;M=8;F=8;S=1 Similarly to Rx, the single transmit link layer and transport layer handles the 4 Tx links of mode se to L=4;M=16;F=8;S=1.
The number of lanes on Rx is reduces to half in order to keep the same lane rate as the Tx link (which has double the channels count of Rx).
Build instructions:
The project must be built with the following parameters:
make JESD_MODE=64B66B RX_JESD_M=8 RX_JESD_L=2 TX_JESD_M=16 TX_JESD_L=4
The Rx links (ADC Path) operate with the following parameters:
- JESD 204C 64b66B mode
- Rx Deframer parameters: L=8, M=32, F=8, S=1, N’=16, N = 16 (equivalent to Quick Config 0x04)
- Dual link : No
- DEVICE_CLK – 250 MHz (Lane Rate/66)
- REF_CLK – 250 MHz
- JESD204C Lane Rate – 16.5 Gbps
- QPLL1
The Tx links (DAC Path) operate with the following parameters:
- JESD 204C 64b66B mode
- Tx Framer parameters: L=16, M=64, F=4, S=1, N’=16, N = 16 (equivalent to Quick Config 0x0B)
- Dual link : No
- DEVICE_CLK – 250 MHz (Lane Rate/66)
- REF_CLK – 250 MHz
- JESD204C Lane Rate – 16.5 Gbps
- QPLL1
Clock sources
The clock sources are depicted on the below diagrams:
Bandwidth considerations
1 MxFE has 8 lanes Max lane rate supported in 204C = 24.75Gbps
Max data rate for one MxFE per direction = 8 * 24.75Gbps * 64/66 = 192 Gbps = 24 GB/s
The existing quad board has half the lanes, this gives us 12GB/s per MxFE per direction The bandwidth requirement per direction is 4 x 12GB/s = 48GB/s
By direction I mean FPGA to DAC path or ADC to FPGA path.
The theoretical throughput of the DDR from the VCU118 is 19.2 GB/s, so far away from the exiting quad MxFE requirements, but an HBM FPGA would solve that.
Software considerations
ADC - crossbar config
Not required, this is handled in the HDL.
DAC - crossbar config
Not required, this is handled in the HDL.
GPIO muxing
GPIO muxing enables multiple functions of gpio_0 pins, to have either the NCO sync function or to be regular software controllable GPIOs.
e.g. function selection for gpio[0] line of MxFE0,1,2,3 done through GPIO[108]
Gpio_0_mode (GPIO[108]) = 0 - Sw controlled GPIO
| Pin Direction | Pin Data out | |
|---|---|---|
| MxFE0_gpio[0] | SW controlled | SW controlled |
| MxFE1_gpio[0] | SW controlled | SW controlled |
| MxFE2_gpio[0] | SW controlled | SW controlled |
| MxFE3_gpio[0] | SW controlled | SW controlled |
Gpio_0_mode (GPIO[108]) = 1 - NCO Sync
| Pin Direction | Pin Data out | |
|---|---|---|
| MxFE0_gpio[0] | Out | MxFE3_gpio[0] |
| MxFE1_gpio[0] | Out | MxFE3_gpio[0] |
| MxFE2_gpio[0] | Out | MxFE3_gpio[0] |
| MxFE3_gpio[0] | In | - |
Function selection for the first six gpio lines is done with the following control GPIOs :
| GPIO group | Function selection GPIO |
|---|---|
| MxFE(0,1,2,3)_gpio[0] | 108 |
More Information
Support
Analog Devices will provide limited online support for anyone using the reference design with Analog Devices components via the EngineerZone.
resources/eval/user-guides/ad_quadmxfe1_ebz/ad_quadmxfe1_ebz_hdl.txt · Last modified: 25 May 2022 10:09 by Laszlo Nagy