View 319282-007_1596534.PDF datasheet online --- IC-ON-LINE

Datasheet File OCR Text:

reference number: 319282-007 revision: 3.2 october 2010 intel ? 82598 10 gbe controller datasheet lan access division features general ? serial flash interface ? 4-wire spi eeprom interface ? configurable led operation for software or oem customization of led displays ? protected eeprom space for private configuration ? device disable capability ? package size - 31 x 31 mm networking ? complies with the 10 gb/s and 1 gb/s ethernet/802.3ap (kx/kx4) specification ? complies with the 10 gb/s ethernet/802.3ae (xaui) specification ? complies with the 1000base-bx specification ? support for jumbo frames of up to 16 kb ? auto negotiation clause 73 for supported mode ? cx4 per 802.3ak ? flow control support: send/receive pause frames and receive fifo thresholds ? statistics for management and rmon ? 802.1q vlan support ? tcp segmentation offload (tso): up to 256 kb ? ipv6 support for ip/tcp and ip/udp receive checksum offload ? fragmented udp checksum offload for packet reassembly ? message signaled interrupts (msi) ? message signaled interrupts (msi-x) ? interrupt throttling control to limit maximum interrupt rate and improve cpu usage ? multiple receive queues (rss) 8 x 8 and 16 x 4 ? 32 transmit queues ? dynamic interrupt moderation ? dca support ? tcp timer interrupts ? no snoop ? relaxed ordering ? support for 16 virtual machines device queues (vmdq) per port host interface ? pci express* (pcie*) specification v2.0 (2.5 gt/s) ? bus width - x1, x2, x4, x8 ? 64-bit address support for systems using more than four gb of physical memory mac f unctions ? descriptor ring management hardware for transmit and receive ? acpi register set and power down functionality supporting d0 and d3 states ? a mechanism for delaying/reducing transmit interrupts ? software-controlled global reset bit (resets everything except the configuration registers) ? eight software-definable pins (sdp) per port ? four of the sdp pins can be configured as general-purpose interrupts ? wakeup ? ipv6 wake-up filters ? configurable flexible filter (through eeprom) ? lan function disable capability ? programmable receive buffer of 512 kb, which can be subdivided to up-to-eight individual packet buffers ? programmable transmit buffer of 320 kb, subdivided into up- to-eight individual packet buffers of 40 kb each ? default configuration by eeprom for all leds for pre-driver functionality manageability ? eight vlan l2 filters ? 16 flex l3 port filters ? four flexible tco filters ? four l3 address filters (ipv4) ? advanced pass through-compatible management packet transmit/receive support ? smbus interface to an external bmc ? nc-si interface to an external bmc ? four l3 address filters (ipv6) ? four l2 address filters
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 2 october 2010 legal information in this document is provided in connection with intel products. no license, express or implied, by estoppel or otherwise, to any intellectual property rights is granted by this document. except as provided in intel's terms and conditions of sale for such products, intel assumes no liability whatsoever and intel disclaims any express or implied warranty, relating to sale and/or use of intel products including liability or warranties relating to fitness for a particular purpose, merchantability, or infringement of any patent, copyright or other intellectual property right. unless otherwise agreed in writing by intel, the intel products are not designed nor intended for any application in which the failure of the intel product could create a situation where personal injury or death may occur. intel may make changes to specifications and product descriptions at any time, without notice. designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined." intel reserves these for future de finition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. the informa tion here is subject to change without notice. do not finalize a design with this information. the products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. current characterized errata are available on request. contact your local intel sales office or your distributor to obtain the latest specifications and before placing your product o rder. copies of documents which have an order number and are referenced in this document, or other intel literature, may be obtained by calling 1-800-548-4725, or by visiting intel's web site. *other names and brands may be claimed as the property of others. copyright ? 2008, 2009, 2010; intel corporation. all rights reserved.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 3 revisions rev date comments 0.75 08/05 ? first integrated version. ? added music and iscsi tso definition. ? initialization chapter updated ? all main functions are integrated. chapters that are not updated: ? nvm memory map. ? manageability. ? power management. 0.89 10/05 first full version. too many changes to list here? revision control indicates changes from zoar. 0.9 11/05 ? pin changes to support 4 more sdp (per port), por baypass, clock bypass, power pin changes and number of spares. ? pcie* read request size is limited to 256b ? removal of pcie* gen 2 support ? updated the initialization sequence for proper link setup at the different modes of network interface ? sync up with zoar c-spec 0.94 ? many address changes in the programming interface ? ball out updated ? added cibolo for the feature summary comparison ? changes in lan/san use of rss ? music chapter was updated, registers and statistics related to music were updated ? added eeprom to csr capability ? link initialization was updated ? modified the tx descriptors to be 8 per queue (instead of 4 and no global descriptors) ? added 10 general purpose semaphores ? eeporm pcie* fields were re-organized, added eeprom words for mac, music ? jumbo frame support up to 16kb ? address changes in programming interface
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 4 october 2010 0.95 01/06 ? added the missing fc statistics ? added control bits for music (recycle mode, receive lsp) ? added register a - packet types for packet split ? reference section updated ? pin names updated to mutch design ? updated error field in the rx descriptor ? udded a column to indicate for each register it internal block location (for internal use only) ? added pbacl, tfcs, mrevid registers ? added missing bits in music configuration ? added missing flow control statistics (were missing in the register description) ? removed pejc register ? added documentation to missing pcie* registers ? fixed old refrences to rctl to the new oplin registers ? changed the sdp control bits location (modified registers ctrl, ext_ctrl and added esdp register) ? removed mpme abd men bits from eeprom load and wuc, added men bit for port 1 in the eeprom (word 0x38) ? only eeprom section pointer of 0xffff will act as non valid pointer. ? removed lpe (bit 2) from fcrtl. ? added advd3wuc to wuc register and added an additional word to be read from the eeprom to load this bit value. ? removed bcn control and status registers (and any other documentation) ? changed the addresses of qptc and qbrc ? added a note that eeprom control words are loaded after perst, inband reast or lan_pwr_good ? removed interrupt statistics ? added frimware eeprom words to section 7 ? removed sol_on and ide_on from fwsm register (reserved) ? fixed and added registers in the mac section to support auto negotiation, dft and better descriptions ? added xec stat (xsum error) at 0x04120 ? added a new mode in desctype to always use the header buffer in split header mode ? removed the fixed partition control bits for rx/tx pb partition and added the rxpbsize/txpbsize registers for pb partition ? removed bwg status registers ? changed the rx status to mng (pif -> reserved) ? removed sw initiated pause transmission capability rev date comments
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 5 1.0 02/06 ? offload for rx ipv6 packets with "home extention" or fragments were changed back to no. ? iscsi support for rx header split was removed (oplin will not support this feature) ? fixed bsizeheader to max at 1024 instead of 16kb as stated. ? chnaged the pcie* analog section load time from lan_pwr_good to be after pe_rst_n instead. ? removed no mng smbus configuration offset from the mng test structure pointer. ? added rclkextp/n clock characterization in the electrical section ? removed the promiscuous cases that stated that pif bit will be cleared ? made bit 25 from "rss field enable" in the mrqc register reserved 0. ? added the pullups table (section 3.2) ? removed ipidv bit from mng status ? changed the default value of the mng_en bit in the grc register so that the mng is enabled by default ? added mngtxmap register that controls the mapping of the mng transmit traffic to the appropriate tc ? added a note that for proper operation pthresh value should be bigger than the number of buffers needed to accommodate a single packet. ? removed drop_en bit from rxdctl and crerated 2 registers dropen0,1 that will hold all drop enable bits (bit per queue). ? changed the addresses of the rnbc statistical counters ? added a bit to bypass the descriptor monitor in the rxctrl ? added the limitation that in music mode rx buffers should be x2 in bsizepacket ? added a bit in rdrxctl to reflect that the dma init is done, this bit was also added to the sw initialization flow (to make sure software waits for dma init done indication) ? removed line 0x13 in the packet types supported by packet split (duplicate to line 0x0) ? removed psr_type0 as there is no l2 split ? changed the atlasctl register so it will support atlas registers read ? added atlas tx-> rx loopback ? added a note that under music jumbo frames support is restricted to 9kb. ? added a mode for txpbsize to support diagnostics that enables the full tx pb (320k) as a single packet buffer. ? added an eeprom word that enables the loading of autoc2 (upper half) from the eeprom. ? added a new statistics for error byte count (0x04008) ? added bits in autoc that reflect the connection speed type (bx,kx,kx4,cx4,xaui) ? changed the format of the "write configuration command" (bmc -> oplin) to support 3 bytes of address instead of 2. ? chenged the format of the "read configuration request" (oplin -> bmc) to support 3 bytes of address instead of 2. ? restricted bsizeheader to 1k bytes rev date comments
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 6 october 2010 1.05 03/06 ? changed the following registers from rw to ro pcs1gdbg0 (0x04210; ro) pcs1gdbg1 (0x04214; ro) pcs1ganlp (0x0421c; ro) pcs1ganlpnp (0x04224; ro) ? removed mbsdc statistic (address 0x04018) ? changed the manageability filtering diagram so it will match the text (added vlan filtering for host after the broadcast filtering) ? changed hthresh possible values to be 0 only ? added two interrupt control bits in gpie. ? removed the totl/h registers from the documentation as they were mapped to the gotl/h and oplin will always transmit good packets ? removed pcs1gsta2 register, the dft capability of this register is covered by other registers. ? changed the structure of eeprom word sdp control - offset 6 so it will match the esdp register structure. ? fixed "other causes" bit in the eicr to cover bots 29:20 in the eicr ? included gpie.msix_mode bit to indicate to provide the interrupt mode of operation to the interrupt block ? included dcn001 ballout and pin changes ? included dcn003 eeprom recovery and protection ? included dcn015 change spare[7] to iddq_mode_en ? included dcn014 support for clause 59 test pattern ? included dcn007 removal of receive iscsi header split support ? included dcn006 removal of transmit iscsi header crc offload support ? included dcn004 mac speed change at different power modes ? included dcn005 new bar for msi-x ? included dcn008 support for san-lan queue mapping in rx ? included dcn016 dma/dbu die size reduction - statistical counters reductions ? changed the pcie* capability version default to be 2h indicating pcie* 2.0 ? added configuration structure to the mng eeprom section ? added "wait for manageability configuration done indication (eemngctl.cfg_done)" to the sw initialization sequence 1.08 ? added (back) pcie* x2 support ? e-spec was updated according per review inputs rev date comments
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 7 1.1 ? link loop-back section was updated (?13.3) ? a note to swizzle bits (?9.2.3.12.25) ? rt2cr register was changed ? the addresses of the following registers were changed: rqsmr, tqsmr, qprc, qptc, qbrc and qbtc. ? hsmc0/1r registers were removed ? gscn_0/1/2/3 changed to read only ? change default of pcie* max read request size to 512 (?4.1.9.7) ? ghost ecc register was added (?13.2.35) ? priority flow control and link flow control can not be enabled together, ? eprom control words 0x0 and 0x38 were changed (?7.3.1) ? two bits were added to gpie register (?9.2.3.5.15) ? hicr register was updated( ?9.2.3.16.1.2) ? next capability pointer default was changed (?4.1.9.8.1.1) ? rmcs and pdpmcs registers were changed ? fixed the note so that master disable bit description will indicate this bit should be cleared by reset and not by the device driver ?6.2.5.3.2, ?9.2.3.1.1) ? removed the sentence: "oplin will not store the smb address that was assigned in the smb arp process in it eeprom, so in the next power-up it will return to its eprom default smb address." ?4.2.1.7.2) ? changed uncorrectable error severity bit 20 to be default 0 per pcie* specification v1.1 ?4.1.9.8.1.4) ? changed and updated fields in mdftc2 and added mdfts2. (?13.2.38, ?13.2.41) ? added indication that ait register is latched high cleared on read. (?9.2.3.12.16) ? added fw_reset_en bit to the manageability capability / manageability enable eerpom register (?7.5.1.4) ? flash frequency was updated to 10mhz according to the design implementation (?11.4.3.4) ? changed defaults of some pcs reserved bits ? added rxdpipesize bits in rdrxctl register ? updated mdio buffers to be regular buffers to match the design and removed the need for external pull-ups for these pins ? added anlp1.anas field ? added apbace bit to gcr ? changed diagnostic registers for pb read/write data/descriptor pointers to match the current design ? included dcn024 change eeprom hw pointers to byte pointers ? included dcn026 remove fml ? include dcn019 remove vlan classification support for vmdq ? include dcn025 change maximum rx buffer size support ? included dcn rmii multicast filtering support rev date comments
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 8 october 2010 1.12 ? updated the eas to properly reflect the fact that mdef[6] is multicast and, as it was not consistent throughout the document ? minr typos and updates at different manageability sections ? updated eas to reflect that only 4 sdp are loaded from eeprom and corrected the sdp control registers in section 1.6.9 ? updated the device initialization sequence to reflect that pcie* analog registers are only loaded after pe_rst_n ? updated eec.fwe bits to be consistent (10 = enabled) ? added mapping from eeprom fields to pci configuration registers ? changed gcr (bit 20) auto pba clear enable to be auto pba clear disable (changed polarity) ? added explanation of how to use gssr register ? added manageability host slave interface command description ? fixed a typo in the bsizeheader definition to indicate it needs to be defined if desctype is greater or equal to 2 ? added customer pin names to the pin interface tables. ? added description of the dft registers in the diagnostic registers section ? rmpn/tdhmpn ecc bits changed to be reserved. ? frtimer should not be used by oplin sw. ? made the cb bits in gcr reserved (no need for cb unlock vdm) ? removed ixsm bit from rx descriptors (not supported). ? mdio auto scan de-featured from oplin. 1.13 12/06 ? fixed the typo in the default number of msi-x vectors supported to 0x13. ? added a note to clarify that sw needs to update the tail descriptor on a packet boundary. ? updated the rsense pin description ? made the ipid_15 bit as reserved ? typo fixes. ? added reserved restriced not for external documentation reference to the de-featured capabilities 1.15 03/07 ? indicate that only 16 msi-x vectors should be used (oplin still supports 20 vectors but for future compatibility only 16 are exposed). ? replaced tpbte to bpbfsm is the relevant place (enable bit name change) ? updated tcase max value to the right value (105c) ? reduced the max number of descriptors per ring to 32k-8. ? updated mdc speeds at 1gbps ? removed (modified to reserved) iscsi_dis and iscsi_dwc from rfctl as they are not implemented in the design ? added optimal performance configurations ? added the dummy function enable bit to nvm and proper description in chapter 5 1.2 ? mng chapter was updated by assaf agmon (major changes) ? power numbers updated 1.25 ? some fixes 08/07 ? fixing "serdes reference clock specification 11.4.6" 1.25.1 08/07 ? patching "power on sequence 11.3.1.1" chapter to limit 1.8v to 1.2v distance to 400usec 1.25.2 08/07 ? patching "power on sequence 11.3.1.1" chapter to increase 1.8v to 1.2v delay requirement to 500usec 1.27 09/07 ? updated the supported receive checksum capabilities table to indicate no tcp/udp checksum offload for tunneled packets ? added the restriction to disable the music arbiter while changing music configuration ? added the restriction to do music configuration after device global reset. ? updated the music tx arbiter scheme to match the hw implemnetation 1.35 01/08 ? updated to match approved dcn047 - changing the 64 bits statistics to 32 bits ? fixed a typo in the bit description of eeprom control word 2 (section 7.3.1.2) ? added nvm word 0x2b - sw phy init pointer ? added jtdo pu indication at active time rev date comments
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 9 1.36 05/08 volume 1 updates/changes/modifications ? updated table 1-5 (starting with rx header replication down to relax ordering ? updated rclkextp/rclkextn pin description (changed +/-0.0 15% to 0 ppm. ? updated section 3.1.6. changed smbclk, smbd, and smbalrt_n types from t/s to o/d. ? added /fml to the note following section 3.1.6. ? updated the note following section 3.1.7. ? updated section 3.1.11. changed customer pin name rsvdb17_nc to lan_pwr_good and customer pin name rsvdac3_nc to por_bypass. ? changed customer pin name rsvdnc to j1_vss in section 3.1.11. ? changed type column for jtdo from t/s to o/d. ? added "internal" to power up and active columns in section 3.2. ? added "external pull-up" to jtdo comment column in section 3.2. ? updated third bullet in section 4.1.3.2. ? updated table 4-12. replaced "v" with "b" for bits 5:3). ? updated device control2 byte, offset 0xa8, (rw) table on page 106. included new text description for bit 15. ? updated section 4.4.4. changed lan "a" to lan "0" and lan "b" to lan "1". ? updated "software reset", link reset" paragraphs on page 227/228. removed "bits that are normally . . .". ? updated section 5.3.3.5. changed "psrctl" to "srrctl". ? deleted "and all descriptors are written back" from the second bullet under "disabling" on page 239. added third bullet "wait until all descriptors . . . ". volume 2 updates/changes/modifications ? removed "see pkttype table for . . . " from the rsv, ipcs, l4cs, udpcs table on page 29. ? removed "see pkttype table for . . . " from the ipcs, l4cs, udpcs table on page 36. ? changed psrctl to srrctl under the hbo section on page 37 (step 1). ? replaced "large send" to "tcp segmentation offload" under the ifcs section on page 62. ? replaced "large send" to "tcp segmentation offload" under the paylen section on page 70. ? replaced "large send" to "tcp segmentation offload" in section 8.2.4. ? replaced "large send" to "tcp segmentation offload" on page 75. ? replaced "large send" to "tcp segmentation offload" in section 8.2.4.7. ? changed tcd fields from two to three in section 8.2.5.2. ? changed suggested range to 651 on page 101. ? changed lso to tso on page 131 (three places) and one place on page 134. ? added the mac manageability control register to table 9-2. ? deleted "an initial suggested range is 65- . . . " from page 222 (right before section 9.2.3.5.8. ? changed tdbha to tdbah on page 250. ? changed lso to tso on page 252. ? changed "configurations" to configuration in the size description table in section 9.2.3.8.11. ? add 0x0 to the initial value field for bits 31:14 in section 9.2.3.10.2. ? fixed two typos in the lphd and lpfd bit descriptions in section 9.2.3.12.7. ? removed "ap" from the bit 0 field in section 9.2.3.14.1. ? added an "*" to the vcc1p8 and vcc1p2 symbols. ? updated section 11.4.2.1. added new total device power numbers and table notes a, b, and c. ? added signal jrst_n to the paragraph just before section 11.4.2.3, ? added zeros to smbd and smbclk signals on page 366. just before section 11.4.2.4. ? updated section 11.4.2.4. added new rmii input and output pads dc specifications. also, deted the two notes just before section 11.4.3. ? updated section 11.4.3.4. added new min and typ values. ? updated section 11.4.3.5. added new min value. rev date comments
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 10 october 2010 1.37 06/08 ? deleted "pu" from lan1_dis_n and lan0_dis_n type column in section 3.1.11. ? deleted "pu" from the jtdi, jtms, and jrst_n type column in section 3.1.12. ? updated table 3-2. added pull-up and pull-down information for rmii_crs_nv, rmii_rxd[0], rmii_rxd[0], mdio[0], mdio[1], ee_cs_n, flsh_cd_n, and jtck. ? added "470 ohm" to jrst_n coment columns in section 3.2. ? updated "revision" paragraph on page 89. replaced word 0x1d to offset 11 - device revision id. ? updated "memory address space" description on page 90. replaced word 0x0f to offset 7 - pcie control. ? updated section 4.1.9.3.3. replaced words 0x24 and 0x14 with "at offset 7 - pcie control". ? updated "address" description on page 93. replaced word 0x0f with "set by the eeprom at offset 7 (pcie control)". ? updated "interrupt pin" paragraph. replaced words 0x24 and 0x14 with "at offset 1, eeprom configuration space 0/1,". ? updated section 4.2.1.3. replaced "(in the lrxen1) word to "at offset 31 - lan 0 receive enable 1". ? updated "vendor specific id" paragraph on page 133. replaced "words 7.3.5.2 in" to "at offset 1-3 (ethernet address)". ? updated "cbdm" description on page 137. replaced "words 0x0-0x2" with "at offset". ? updated paragraph on page 143 beginning with "oplin responds to one of the commands . . ". ? updated section 6.2.4.2. replaced "7.3.1.2 word" to "at address 0x00 (eeprom control word 1)". ? updated second paragraph in section 6.2.5.1 beginning with "enable port 1/0 . . . ". ? updated third and fourth bullet in section 6.2.5.4.2 beginning with "as loaded from the eeprom . . . ". ? deleted the rxe bit description from page 37. ? updated the "rst" bit description in device control register table (bit 26). ? updated the unlock_eep bit description in the 9.2.3.4.16firmware semaphore register (bit 28). ? updated sections 9.2.3.13.49 and 9.2.3.13.509. included new rqsmr and tqsmr descriptions. ? added "- (for both read and write-back formats)" to sta field description on page 69. 2.0 12/08 ? converted to single source using framemaker. ? updated internal/external pull-up/pull-down information. 2.2 february 2008 initial release (intel public). 2.3 may 2008 updated sections/figures/tables: product features, 1.9.9, 2.2, 2.3, 2.9, 2.13, table 2-17, 3.1.1.6, table 3-17, 3.1.1.14.4, note after table 3-25, device cap, device control, device status, link cap lin control, link status, tables in section 3.1.1.14.6, 3.1.3.1, figure 3- 10, 3.2.1.2, 3.2.1.3, table 3-38, table 3-39, 3.2.3.2.5, figure 3-12, figure 3-13, 3.3.2.3.1.7, table 3-45, 3.4.3.1.1, 3.4.3.1.2, 3.4.3.4.2, 3.4.3.6.2, figure 3-20, figure 3- 21, table 3-54, 3.5.2.4, 3.5.2.8, 3.5.2.10.1, 3.5.2.11, table 3-59, table 3-69, 3.5.3.3.2, 3.5.4.1, 3.5.4.2, table 4-2, table 4-4, 4.4.3.3.1 through 4.4.3.7, 4.4.3.3.12, 4.4.3.5.7 through 4.4.5.9, 4.4.3.6.2, 4.4.3.6.8, 4.4.3.6.11, 4.4.3.9, 4.4.3.11.1, 4.4.3.13.5, 4.4.3.13.8 through 4.4.3.13.10, 4.4.3.13.24, table 5-7 through table 5-10, table 5-12, and 5.6.4, 5.6.6. 2.4 august 2008 replaced large send offload (lso) with tcp segmentation offload (tso). removed all references to ?header replication?. updated reference schematics. updated tables: 2-12, 2-14, 2-16, 3-17, 3-58, 3-71, 4-4, 5-3 through 5-5, 5-12, 5-15, 5- 19, updated section: 1.2, 1.8, 1.9.10, 2.13, 3.1.1.10.1, 3.1.1.14.2, 3.2.2.14.3.1, 3.1.1.14.4, 3.1.4.3.4, 3.2.1.3, 3.3.1.3.2, 3.3.1.4.1, 3.3.1.4.4.2, 3.4 through 3.4.4, 3.5.2, 4.4.3.1.1, 4.4.3.3.7, 4.4.3.5.7, 4.4.3.6.4, 4.4.3.9.49, 4.4.3.9.50, 5.4.3, 5.5.1, 7.6, 7.8, 7.13.2. rev date comments
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 11 2.5 november 2008 updated section: 3.2.1.2, 3.4.2.2.8, 3.4.2.3.2, 3.4.2.3.3, 3.4.2.5.2, 3.4.2.5.4, 3.4.3, 3.5.2.13, 3.5.3.2, 3.5.3.3.1.1, 3.5.3.3.1.3, 3.5.5.2, 3.5.5.3.1. 3.5.5.3.2, 3.5.6.1, 3.5.7, 4.4.3.1.6, 4.4.3.5.7, 4.4.3.6.13, 4.4.3.7.6, 4.4.3.9.5, 4.4.3.10.5, 4.4.3.10.6, 4.4.3.10.7, 4.4.3.10.8, 4.4.3.10.9, 4.4.3.13.8, 4.4.3.13.15, 4.4.3.13.23, 4.4.3.13.24, 4.4.3.13.25, 5.4.2, 5.5.1, 5.5.2, 5.6.6, and 5.6.6.1. updated table 5-2, 5-6 and supported figure. updated figure 5-1 notes. added section 7.16.8. 3.1 april 2009 section 4.4.3.5.12, drop enable control ? dropen (0x03d04 ? 0x03d08; rw) - description updated for clarity. section 5.3.12.9, still having problems? & section 5.3.12.5.1, firmware semaphore register (fwsm, 0x10148) - fwsm indicated in both places. 0x10148 is the correction. section 5.3.13, sample configurations - sample filtering configurations added. section 9.1.1, ghost ecc register - gheccr (0x110b0, rw) . diagnostic register added to public documentation because it has limited public use as a workaround. support for pcie* statistics counters dropped. 3.2 october 2010 section 3.4.2.2, pba number module ? words 0x15:0x16 . updated to reflect new methodology. rev date comments
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 12 october 2010 contents 1. general information ..................................................................................................................31 1.1 introduction ................................................................................................................ ................ 31 1.2 terminology and acronyms .................................................................................................... .......31 1.3 reference documents ......................................................................................................... ..........33 1.4 models and symbols .......................................................................................................... ...........35 1.5 physical layer conformance testing .......................................................................................... .....35 1.6 design and board layout checklists.......................................................................................... ......35 1.7 number conventions .......................................................................................................... ..........35 1.8 system configurations ....................................................................................................... ...........35 1.9 external interfaces ......................................................................................................... ..............36 1.9.1 pcie interface ............................................................................................................ ....37 1.9.2 xaui interfaces ........................................................................................................... ...37 1.9.3 eeprom interface .......................................................................................................... .38 1.9.4 serial flash interface.................................................................................................... ...39 1.9.5 smbus interface ........................................................................................................... ..39 1.9.6 nc-si interface ........................................................................................................... ...39 1.9.7 mdio interfaces........................................................................................................... ...39 1.9.8 software-definable pins (sdp) interface (general-purpose i/o).............................................40 1.9.9 led interface ............................................................................................................. ....40 2. signal descriptions and pinout list ............................................................................................41 2.1 signal type definitions ..................................................................................................... ............41 2.2 pcie interface .............................................................................................................. ............... 42 2.3 xaui interface signals ...................................................................................................... ............43 2.4 eeprom and serial flash interface signals ................................................................................... ...45 2.5 smbus and nc-si signals..................................................................................................... .........45 2.6 mdi/o signals ............................................................................................................... .............. 46 2.7 software-definable pins ..................................................................................................... ...........46 2.8 led signals ................................................................................................................. ................ 47 2.9 miscellaneous signals ....................................................................................................... ............47 2.10 test interface signals ..................................................................................................... ..............48 2.11 power supplies ............................................................................................................. ............... 48 2.12 alphabetical pinout/signal name ............................................................................................ ........50 2.13 internal/external pull-up/pull-down specifications......................................................................... ...61 2.14 pin assignments (ball out) ................................................................................................. ...........63 3. functional description ...............................................................................................................69 3.1 interconnects ............................................................................................................... ............... 69 3.1.1 pcie...................................................................................................................... ........ 69 3.1.1.1 architecture, transaction and link layer properties ..............................................70 3.1.1.1.1 physical interface properties .......................................................................71 3.1.1.1.2 advanced extensions .................................................................................71 3.1.1.2 general functionality .......................................................................................71 3.1.1.2.1 native/legacy ...........................................................................................71 3.1.1.2.2 locked transactions ..................................................................................71 3.1.1.2.3 end-to-end crc (ecrc) .............................................................................71 3.1.1.3 host interface .................................................................................................71 3.1.1.3.1 tag id allocation .......................................................................................72 3.1.1.3.2 completion timeout mechanism ..................................................................74 3.1.1.3.2.1 completion timeout enable .....................................................................74 3.1.1.3.2.2 resend request enable...........................................................................74 3.1.1.3.2.3 completion timeout period......................................................................75 3.1.1.4 transaction layer ............................................................................................75 3.1.1.4.1 transaction types accepted ........................................................................76 3.1.1.4.1.1 partial memory read and write requests...................................................76 3.1.1.4.2 transaction types initiated .........................................................................77
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 13 3.1.1.4.2.1 data alignment......................................................................................77 3.1.1.4.2.2 multiple tx data read requests (mulr) ....................................................78 3.1.1.5 messages .......................................................................................................78 3.1.1.5.1 received messages ....................................................................................78 3.1.1.5.2 transmitted messages................................................................................78 3.1.1.6 ordering rules ................................................................................................79 3.1.1.6.1 out of order completion handling ...............................................................80 3.1.1.7 transaction definition and attributes ..................................................................80 3.1.1.7.1 max payload size ......................................................................................80 3.1.1.7.2 traffic class (tc) and virtual channels (vc)..................................................80 3.1.1.7.3 relaxed ordering ......................................................................................80 3.1.1.7.4 no snoop .................................................................................................80 3.1.1.7.5 no snoop and relaxed ordering for lan traffic .............................................81 3.1.1.7.5.1 no snoop option for payload ...................................................................81 3.1.1.8 flow control ...................................................................................................81 3.1.1.8.1 82598 flow control rules ...........................................................................81 3.1.1.8.2 upstream flow control tracking ..................................................................82 3.1.1.8.3 flow control update frequency ...................................................................82 3.1.1.8.4 flow control timeout mechanism.................................................................82 3.1.1.9 error forwarding .............................................................................................83 3.1.1.10 link layer ......................................................................................................83 3.1.1.10.1 ack/nak scheme......................................................................................83 3.1.1.10.2 supported dllps .......................................................................................83 3.1.1.10.3 transmit edb nullifying..............................................................................84 3.1.1.11 phy ...............................................................................................................84 3.1.1.11.1 link speed ...............................................................................................84 3.1.1.11.2 link width ................................................................................................84 3.1.1.11.3 polarity inversion ......................................................................................84 3.1.1.11.4 l0s exit latency ........................................................................................85 3.1.1.11.5 lane-to-lane de-skew...............................................................................85 3.1.1.11.6 lane reversal ...........................................................................................85 3.1.1.11.7 reset.......................................................................................................87 3.1.1.11.8 scrambler disable .....................................................................................87 3.1.1.12 error events and error reporting .......................................................................87 3.1.1.12.1 general description ...................................................................................87 3.1.1.12.2 error events .............................................................................................88 3.1.1.12.3 error pollution...........................................................................................90 3.1.1.12.4 completion with unsuccessful completion status ..........................................90 3.1.1.12.5 error reporting changes ............................................................................90 3.1.1.13 performance monitoring....................................................................................91 3.1.1.14 configuration registers ....................................................................................91 3.1.1.14.1 pci compatibility.......................................................................................91 3.1.1.14.2 configuration sharing among pci functions ..................................................92 3.1.1.14.3 mandatory pci configuration registers .........................................................93 3.1.1.14.3.1 expansion rom base address ..................................................................98 3.1.1.14.4 pci power management registers ................................................................99 3.1.1.14.5 msi configuration.................................................................................... 102 3.1.1.14.6 msi-x configuration ................................................................................ 103 3.1.1.14.7 pcie configuration registers ..................................................................... 107 3.1.1.14.8 pcie extended configuration space ........................................................... 115 3.1.1.14.8.1 advanced error reporting capability ....................................................... 116 3.1.1.14.8.2 serial number ..................................................................................... 120 3.1.2 manageability interfaces (smbus/nc-si) .......................................................................... 122 3.1.2.1 smbus pass-through interface ........................................................................ 123 3.1.2.1.1 general.................................................................................................. 123 3.1.2.1.2 pass-through capabilities ......................................................................... 123 3.1.2.2 nc-si .......................................................................................................... 123 3.1.2.2.1 interface specification.............................................................................. 123 3.1.2.2.2 electrical characteristics........................................................................... 124 3.1.2.2.3 nc-si transactions .................................................................................. 124
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 14 october 2010 3.1.2.2.3.1 nc-si-smbus mode .............................................................................. 124 3.1.2.2.3.2 nc-si mode......................................................................................... 124 3.1.3 non-volatile memory (eeprom/flash) .............................................................................. 125 3.1.3.1 eeprom ....................................................................................................... 125 3.1.3.1.1 software accesses ................................................................................... 125 3.1.3.1.2 signature field........................................................................................ 126 3.1.3.1.3 protected eeprom space.......................................................................... 126 3.1.3.1.3.1 initial eeprom programming ................................................................. 126 3.1.3.1.3.2 eeprom protected areas ....................................................................... 126 3.1.3.1.3.3 activating the protection mechanism ....................................................... 126 3.1.3.1.3.4 non permitted accesses to protected areas in the eeprom ........................ 127 3.1.3.1.4 eeprom recovery ................................................................................... 127 3.1.3.2 flash............................................................................................................ 128 3.1.3.2.1 flash interface operation ......................................................................... 128 3.1.3.2.2 flash write control .................................................................................. 129 3.1.3.2.3 flash erase control.................................................................................. 129 3.1.3.2.4 flash access contention ........................................................................... 129 3.1.4 network interface ......................................................................................................... 129 3.1.4.1 10 gbe interface ........................................................................................... 129 3.1.4.1.1 xgxs ? pcs/pma .................................................................................... 130 3.1.4.2 gbe interface................................................................................................ 131 3.1.4.3 auto negotiation and link setup features ......................................................... 131 3.1.4.3.1 link configuration ................................................................................... 131 3.1.4.3.2 mac link setup and auto negotiation......................................................... 132 3.1.4.3.3 hardware detection of non-auto negotiation partner.................................... 132 3.1.4.4 mdio/mdc ................................................................................................... 132 3.1.4.4.1 mdio direct access ................................................................................. 132 3.1.4.5 ethernet (legacy) flow control........................................................................ 133 3.1.4.5.1 mac control frames and reception of flow control packets .......................... 133 3.1.4.5.2 discard pause frames and pass mac control frames.................................... 134 3.1.4.5.3 transmission of pause frames................................................................... 134 3.1.4.6 mac speed change at different power modes .................................................... 135 3.2 initialization .............................................................................................................. ................ 136 3.2.1 power up .................................................................................................................. ... 136 3.2.1.1 power-up sequence ....................................................................................... 136 3.2.1.2 power-up timing diagram .............................................................................. 138 3.2.1.2.1 timing requirements ............................................................................... 139 3.2.1.2.2 timing guarantees .................................................................................. 139 3.2.1.3 reset operation ............................................................................................ 140 3.2.2 specific function enable/disable ..................................................................................... 143 3.2.2.1 general ........................................................................................................ 143 3.2.2.2 overview ...................................................................................................... 143 3.2.2.3 event flow for enable/disable functions ........................................................... 144 3.2.2.3.1 bios disable the lan function at boot time by using strapping option.......... 144 3.2.2.3.2 multi-function advertisement .................................................................... 145 3.2.2.3.3 interrupt use .......................................................................................... 145 3.2.2.3.4 power reporting...................................................................................... 145 3.2.2.4 device disable overview................................................................................. 145 3.2.2.4.1 bios disable the device at boot time by using strapping option................... 145 3.2.3 software initialization and diagnostics ............................................................................. 146 3.2.3.1 power up state ............................................................................................. 146 3.2.3.2 initialization sequence ................................................................................... 146 3.2.3.2.1 disabling interrupts during initialization ..................................................... 146 3.2.3.2.2 global reset and general configuration ...................................................... 146 3.2.3.2.3 link setup mechanisms and control/status bit summary .............................. 147 3.2.3.2.3.1 bx 1 gb/s link setup............................................................................ 147 3.2.3.2.3.2 10 gb/s link setup............................................................................... 147 3.2.3.2.4 initialization of statistics .......................................................................... 148 3.2.3.2.5 receive initialization ................................................................................ 148 3.2.3.2.6 dynamic enabling and disabling of receive queues...................................... 149
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 15 3.2.3.2.7 transmit initialization .............................................................................. 149 3.2.3.2.8 dynamic enabling and disabling of transmit queues .................................... 150 3.3 power management and delivery............................................................................................... ... 150 3.3.1 power delivery ............................................................................................................ . 150 3.3.1.1 82598 power states ....................................................................................... 150 3.3.1.2 auxiliary power usage .................................................................................... 151 3.3.1.3 interconnects power management.................................................................... 152 3.3.1.3.1 pcie link power management ................................................................... 152 3.3.1.3.2 network interfaces power management ...................................................... 154 3.3.1.4 power states................................................................................................. 154 3.3.1.4.1 d0 uninitialized state............................................................................... 154 3.3.1.4.1.1 entry into d0u state............................................................................. 154 3.3.1.4.2 d0active state ........................................................................................ 154 3.3.1.4.2.1 entry to d0a state ............................................................................... 155 3.3.1.4.3 d3 state (pci-pm d3hot).......................................................................... 155 3.3.1.4.3.1 entry to d3 state ................................................................................. 155 3.3.1.4.3.2 master disable ..................................................................................... 155 3.3.1.4.4 dr state ................................................................................................. 156 3.3.1.4.4.1 dr disable mode................................................................................... 156 3.3.1.4.4.2 entry to dr state.................................................................................. 157 3.3.1.5 timing of power-state transitions.................................................................... 157 3.3.1.5.1 transition from d0a to d3 and back without pe_rst_n ................................ 158 3.3.1.5.2 transition from d0a to d3 and back with pe_rst_n .................................... 159 3.3.1.5.3 transition from d0a to dr and back without transition to d3 ........................ 161 3.3.1.5.4 timing requirements ............................................................................... 161 3.3.1.5.5 timing guarantees .................................................................................. 162 3.3.2 wake up ................................................................................................................... ... 163 3.3.2.1 advanced power management wake up ............................................................ 163 3.3.2.2 acpi power management wakeup .................................................................... 164 3.3.2.3 wake-up packets........................................................................................... 164 3.3.2.3.1 pre-defined filters ................................................................................... 165 3.3.2.3.1.1 directed exact packet ........................................................................... 165 3.3.2.3.1.2 directed multicast packet ...................................................................... 165 3.3.2.3.1.3 broadcast ........................................................................................... 165 3.3.2.3.1.4 magic packet* ..................................................................................... 166 3.3.2.3.1.5 arp/ipv4 request packet ...................................................................... 167 3.3.2.3.1.6 directed ipv4 packet ............................................................................ 168 3.3.2.3.1.7 directed ipv6 packet ............................................................................ 168 3.3.2.3.2 flexible filter .......................................................................................... 169 3.3.2.3.2.1 ipx diagnostic responder request packet ............................................... 169 3.3.2.3.2.2 directed ipx packet .............................................................................. 170 3.3.2.3.2.3 ipv6 neighbor discovery filter ............................................................... 170 3.3.2.3.3 wake-up packet storage .......................................................................... 170 3.4 nvm map (eeprom) ............................................................................................................ ....... 171 3.4.1 eeprom general map .................................................................................................... 171 3.4.2 eeprom software section .............................................................................................. 172 3.4.2.1 compatibility fields ? words 0x10-0x14 ........................................................... 172 3.4.2.2 pba number module ? words 0x15:0x16 .......................................................... 172 3.4.2.3 software eegen work area............................................................................. 174 3.4.2.3.1 ds_version ? word 0x29.......................................................................... 174 3.4.2.3.2 oem version and id ? word 0x2a.............................................................. 174 3.4.2.3.3 software init section pointer ? word 0x2.................................................... 174 3.4.2.3.4 etrack_id ? word 0x2d:2e ...................................................................... 174 3.4.2.4 pxe configuration words ? word 0x30:3b......................................................... 175 3.4.2.4.1 setup options pci function 0 ? word 0x30 ................................................. 175 3.4.2.4.2 configuration customization options pci function 0 ? word 0x31 .................. 176 3.4.2.4.3 pxe version ? word 0x32 ........................................................................ 177 3.4.2.4.4 iba capabilities ? word 0x33 .................................................................... 177 3.4.2.4.5 setup options pci function 1 ? word 0x34 ................................................. 177 3.4.2.4.6 configuration customization options pci function 1 ? word 0x35 .................. 177
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 16 october 2010 3.4.2.4.7 setup options pci function 2 ? word 0x38 ................................................. 177 3.4.2.4.8 configuration customization options pci function 2 ? word 0x39 .................. 178 3.4.2.4.9 setup options pci function 3 ? word 0x3a ................................................. 178 3.4.2.4.10 configuration customization options pci function 3 ? word 0x3b .................. 178 3.4.2.5 eeprom checksum calculation ........................................................................ 178 3.4.3 hardware eeprom sections............................................................................................ 179 3.4.3.1 eeprom init section ...................................................................................... 179 3.4.3.1.1 eeprom control word 1 ? address 0x00..................................................... 179 3.4.3.1.2 eeprom control word 2 ? address 0x01..................................................... 180 3.4.3.1.3 eeprom control word 3 ? address 0x38..................................................... 180 3.4.3.2 eeprom hardware pointers ............................................................................. 180 3.4.3.2.1 analog configuration sections ? words 0x04:0x05....................................... 180 3.4.3.2.1.1 eeprom analog configuration ? section length ....................................... 181 3.4.3.2.1.2 eeprom analog configuration ? data word ............................................. 181 3.4.3.2.2 pcie analog pointer ? word 0x03 .............................................................. 181 3.4.3.2.2.1 pcie analog ? section length ................................................................ 181 3.4.3.2.2.2 pcie analog selector ............................................................................ 181 3.4.3.2.2.3 pcie analog word ................................................................................ 182 3.4.3.3 eeprom pcie general configuration section ..................................................... 182 3.4.3.3.1 pcie general configuration ? section length............................................... 183 3.4.3.3.2 pcie init configuration 1 ? offset 1 ........................................................... 183 3.4.3.3.3 pcie init configuration 2 ? offset 2 ........................................................... 185 3.4.3.3.4 pcie init configuration 3 ? offset 3 ........................................................... 185 3.4.3.3.5 pcie control ? offset 4 ............................................................................ 186 3.4.3.3.6 pcie control ? offset 5 ............................................................................ 187 3.4.3.3.7 pcie control ? offset 6 ? lan power consumption ....................................... 188 3.4.3.3.8 pcie control ? offset 7 ............................................................................ 188 3.4.3.3.9 pcie control ? offset 8 ? sub-system id.................................................... 188 3.4.3.3.10 pcie control ? offset 9 ? sub-system vendor id ......................................... 189 3.4.3.3.11 pcie control ? offset 10 ? dummy device id .............................................. 189 3.4.3.3.12 pcie control ? offset 11 ? device revision id ............................................. 189 3.4.3.4 eeprom pcie configuration space 0/1 sections................................................. 189 3.4.3.4.1 pcie configuration space 0/1 ? section length ........................................... 189 3.4.3.4.2 eeprom pcie configuration space 0/1- offset 1 .......................................... 190 3.4.3.4.3 eeprom pcie configuration space 0/1 ? offset 2 device id .......................... 190 3.4.3.5 eeprom core 0/1 section ............................................................................... 190 3.4.3.5.1 core configuration section ? section length ............................................... 191 3.4.3.5.2 ethernet address ? offset 1-3 ................................................................... 191 3.4.3.5.3 leds configuration ? offset 4-5 ................................................................ 192 3.4.3.5.4 sdp control ? offset 6 ............................................................................. 192 3.4.3.5.5 filter control ? offset 7 ............................................................................ 193 3.4.3.6 eeprom mac 0/1 sections .............................................................................. 193 3.4.3.6.1 mac configuration section ? section length ............................................... 193 3.4.3.6.2 link mode configuration ? offset 1 ............................................................ 194 3.4.3.6.3 swap configuration ? offset 2 .................................................................. 195 3.4.3.6.4 swizzle and polarity configuration ? offset 3............................................... 196 3.4.3.6.5 auto negotiation defaults ? offset 4 .......................................................... 197 3.4.3.6.6 autoc2 ? upper half? offset 5 ................................................................. 198 3.4.4 hardware section ? auto-read ....................................................................................... 198 3.4.5 manageability control sections........................................................................................ 199 3.4.5.1 common firmware pointers ............................................................................ 199 3.4.5.1.1 test configuration pointer ? (global offset 0x0) .......................................... 200 3.4.5.1.2 loader patch pointer ? (global offset 0x1).................................................. 200 3.4.5.1.3 no manageability patch pointer ? (global offset 0x2) ................................... 200 3.4.5.1.3.1 manageability capability/manageability enable ? (global offset 0x3) ........... 200 3.4.5.1.3.2 nc-si configuration pointer ? (global offset 0x4)..................................... 201 3.4.5.1.4 test structure......................................................................................... 201 3.4.5.1.4.1 section header ? (offset 0x0)................................................................ 201 3.4.5.1.4.2 loopback test configuration ? (offset 0x1) ............................................. 201 3.4.5.1.5 patch structure ....................................................................................... 201
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 17 3.4.5.1.5.1 patch data size ? (offset 0x0) ............................................................... 201 3.4.5.1.5.2 block crc8? (offset 0x1) ...................................................................... 202 3.4.5.1.5.3 patch entry point pointer low word ? (offset 0x2).................................... 202 3.4.5.1.5.4 patch entry point pointer high word ? (offset 0x3)................................... 202 3.4.5.1.5.5 patch version 1 word ? (offset 0x4) ....................................................... 202 3.4.5.1.5.6 patch version 2 word ? (offset 0x5) ....................................................... 202 3.4.5.1.5.7 patch version 3 word ? (offset 0x6) ....................................................... 203 3.4.5.1.5.8 patch version 4 word ? (offset 0x7) ....................................................... 203 3.4.5.1.5.9 patch data words ? (offset 0x8 ? block length) ...................................... 203 3.4.5.1.6 pass through control words ..................................................................... 203 3.4.5.1.6.1 pass through pointers .......................................................................... 203 3.4.5.1.6.1.1 pass through patch configuration pointer ? (global offset 0x4) ............ 203 3.4.5.1.6.1.2 pass through lan 0 configuration pointer ? (global offset 0x5) ........... 203 3.4.5.1.6.1.3 sideband configuration pointer ? (global offset 0x6) .......................... 204 3.4.5.1.6.1.4 flexible tco filter configuration pointer ? (global offset 0x7) .............. 204 3.4.5.1.6.1.5 pass through lan 1 configuration pointer ? (global offset 0x8) ........... 204 3.4.5.1.6.1.6 nc-si microcode download pointer ? (global offset 0x9) ..................... 204 3.4.5.1.6.2 pass through lan configuration structure............................................... 204 3.4.5.1.6.2.1 section header ? (0ffset 0x0) .......................................................... 204 3.4.5.1.6.2.2 lan 0 ipv4 address 0 (lsb) mipaf0 ? (0ffset 0x01)............................ 204 3.4.5.1.6.2.3 lan 0 ipv4 address 0 (msb) (mipaf0) ? (0ffset 0x02) ........................ 205 3.4.5.1.6.2.4 lan 0 ipv4 address 1 mipaf1 ? (0ffset 0x03-x004) ............................ 205 3.4.5.1.6.2.5 lan 0 ipv4 address 2 mipaf2 ? (0ffset 0x05-0x06) ............................ 205 3.4.5.1.6.2.6 lan 0 ipv4 address 3 mipaf3 ? (0ffset 0x07-0x08) ............................ 205 3.4.5.1.6.2.7 lan 0 mac address 0 (lsb) mmal0 ? (0ffset 0x09) ............................ 205 3.4.5.1.6.2.8 lan 0 mac address 0 (lsb) mmal0 ? (0ffset 0x0a) ............................ 205 3.4.5.1.6.2.9 lan 0 mac address 0 (msb) mmah0 ? (0ffset 0x0b)........................... 205 3.4.5.1.6.2.10 lan 0 mac address 1 mmal/h1 ? (0ffset 0x0c-0x0e) ......................... 205 3.4.5.1.6.2.11 lan 0 mac address 2 mmal/h2 ? (0ffset 0x0f-0x11).......................... 206 3.4.5.1.6.2.12 lan 0 mac address 3 mmal/h3 ? (0ffset 0x12-0x14) ......................... 206 3.4.5.1.6.2.13 lan 0 udp flexible filter ports 0 ? 15 (mfutp registers) ? (0ffset 0x15-0x24) ......................................................................... 206 3.4.5.1.6.2.14 lan 0 vlan filter 0 ? 7 (mavtv registers) ? (0ffset 0x25 ? 0x2c) ....... 206 3.4.5.1.6.2.15 lan 0 manageability filters valid (mfval lsb) ? (0ffset 0x2d) ............. 206 3.4.5.1.6.2.16 lan 0 manageability filters valid (mfval msb) ? (0ffset 0x2e)............. 206 3.4.5.1.6.2.17 lan 0 manc value lsb (lmanc lsb) ? (0ffset 0x2f) .......................... 207 3.4.5.1.6.2.18 lan 0 manc value msb (lmanc msb) ? (0ffset 0x30) ........................ 207 3.4.5.1.6.2.19 lan 0 receive enable 1 (lrxen1) ? (0ffset 0x31)............................... 207 3.4.5.1.6.2.20 lan 0 receive enable 2 (lrxen2) ? (0ffset 0x32)............................... 208 3.4.5.1.6.2.21 lan 0 manc2h value (lmanc2h lsb) ? (0ffset 0x33)......................... 208 3.4.5.1.6.2.22 lan 0 manc2h value (lmanc2h msb) ? (0ffset 0x34) ........................ 208 3.4.5.1.6.2.23 manageability decision filters- mdef0 (1) ? (0ffset 0x35) .................... 208 3.4.5.1.6.2.24 manageability decision filters- mdef0 (2) ? (0ffset 0x36) .................... 209 3.4.5.1.6.2.25 manageability decision filters- mdef1-6 (1-2) ? (0ffset 0x37-0x42)...... 209 3.4.5.1.6.2.26 arp response ipv4 address 0 (lsb) ? (0ffset 0x43) ........................... 209 3.4.5.1.6.2.27 arp response ipv4 address 0 (msb) ? (0ffset 0x44)........................... 209 3.4.5.1.6.2.28 lan 0 ipv6 address 0 (lsb) (mipaf) ? (0ffset 0x45) ........................... 210 3.4.5.1.6.2.29 lan 0 ipv6 address 0 (msb) (mipaf) ? (0ffset 0x46) .......................... 210 3.4.5.1.6.2.30 lan 0 ipv6 address 0 (lsb) (mipaf) ? (0ffset 0x47) ........................... 210 3.4.5.1.6.2.31 lan 0 ipv6 address 0 (msb) (mipaf) ? (0ffset 0x48) .......................... 210 3.4.5.1.6.2.32 lan 0 ipv6 address 0 (lsb) (mipaf) ? (0ffset 0x49) ........................... 210 3.4.5.1.6.2.33 lan 0 ipv6 address 0 (msb) (mipaf) ? (0ffset 0x4a) .......................... 211 3.4.5.1.6.2.34 lan 0 ipv6 address 0 (lsb) (mipaf) ? (0ffset 0x4b)........................... 211 3.4.5.1.6.2.35 lan 0 ipv6 address 0 (msb) (mipaf) ? (0ffset 0x4c) .......................... 211 3.4.5.1.6.2.36 lan 0 ipv6 address 1 (mipaf) ? (0ffset 0x4d-0x54) ........................... 211 3.4.5.1.6.2.37 lan 0 ipv6 address 2 (mipaf) ? (0ffset 0x55-0x5c) ........................... 211 3.4.5.1.7 smbus configuration structure.................................................................. 211 3.4.5.1.7.1 section header ? (0ffset 0x0) ................................................................ 211 3.4.5.1.7.2 smbus maximum fragment size ? (0ffset 0x01) ....................................... 212 3.4.5.1.7.3 smbus notification timeout and flags ? (0ffset 0x02) ............................... 212
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 18 october 2010 3.4.5.1.7.4 smbus slave addresses ? (0ffset 0x03)................................................... 212 3.4.5.1.7.5 fail-over register (low word) ? (0ffset 0x04) ......................................... 213 3.4.5.1.7.6 fail-over register (high word) ? (0ffset 0x05) ........................................ 213 3.4.5.1.7.7 nc-si configuration (0ffset 0x06) .......................................................... 213 3.4.5.1.8 flexible tco filter configuration structure .................................................. 214 3.4.5.1.8.1 section header ? (0ffset 0x0) ................................................................ 214 3.4.5.1.8.2 flexible filter length and control ? (0ffset 0x01) ..................................... 214 3.4.5.1.8.3 flexible filter enable mask ? (0ffset 0x02 ? 0x09) .................................... 214 3.4.5.1.8.4 flexible filter data ? (0ffset 0x0a ? block length) .................................... 214 3.4.5.1.9 nc-si microcode download structure ......................................................... 215 3.4.5.1.9.1 patch data size ? (offset 0x0) ............................................................... 215 3.4.5.1.9.2 rx and tx code size ? (offset 0x1) ........................................................ 215 3.4.5.1.9.3 download data ? (offset 0x2 ? data size)............................................... 215 3.4.5.1.10 nc-si configuration structure................................................................... 215 3.4.5.1.10.1 section header (0ffset 0x0)................................................................... 215 3.4.5.1.10.2 rx mode control1 (rr_ctrl[15:0]) (offset 0x1)...................................... 216 3.4.5.1.10.3 rx mode control2 (rr_ctrl[31:16]) (offset 0x2) .................................... 216 3.4.5.1.10.4 tx mode control1 (rt_ctrl[15:0]) (offset 0x3) ...................................... 216 3.4.5.1.10.5 tx mode control2 (rt_ctrl[31:16]) (offset 0x4) .................................... 216 3.4.5.1.10.6 mac tx control reg1 (txcntrlreg1 (15:0]) (offset 0x5)............................ 217 3.4.5.1.10.7 nc-si settings (ncsiset) (offset 0x7) ................................................... 217 3.5 rx/tx functions ............................................................................................................. ............ 217 3.5.1 device data/control flows.............................................................................................. 217 3.5.1.1 transmit data flow ........................................................................................ 217 3.5.1.2 rx data flow ................................................................................................ 219 3.5.2 receive functionality ..................................................................................................... 220 3.5.2.1 packet filtering ............................................................................................. 223 3.5.2.1.1 l2 filtering ............................................................................................. 224 3.5.2.1.1.1 unicast filter ....................................................................................... 226 3.5.2.1.1.2 multicast filter (partial) ......................................................................... 226 3.5.2.1.2 vlan filtering ......................................................................................... 226 3.5.2.2 intel? 82598 10 gbe controller system manageability interface application notereceive data storage................................................................................................. 227 3.5.2.3 legacy receive descriptor format.................................................................... 228 3.5.2.4 advanced receive descriptors ......................................................................... 230 3.5.2.5 receive udp fragmentation checksum ............................................................. 237 3.5.2.6 receive descriptor fetching ............................................................................ 237 3.5.2.7 receive descriptor write-back......................................................................... 238 3.5.2.8 receive descriptor queue structure ................................................................. 238 3.5.2.9 header splitting and replication ...................................................................... 240 3.5.2.9.1 purpose ................................................................................................. 240 3.5.2.9.2 description ............................................................................................. 240 3.5.2.10 receive-side scaling (rss) ............................................................................. 242 3.5.2.10.1 rss hash function .................................................................................. 244 3.5.2.10.1.1 hash for ipv4 with tcp ......................................................................... 246 3.5.2.10.1.2 hash for ipv4 with udp ......................................................................... 246 3.5.2.10.1.3 hash for ipv4 without tcp ..................................................................... 246 3.5.2.10.1.4 hash for ipv6 with tcp ......................................................................... 246 3.5.2.10.1.5 hash for ipv6 with udp ......................................................................... 247 3.5.2.10.1.6 hash for ipv6 without tcp ..................................................................... 247 3.5.2.10.2 indirection table ..................................................................................... 247 3.5.2.10.3 rss verification suite .............................................................................. 247 3.5.2.11 receive queuing for virtual machine devices (vmdq).......................................... 248 3.5.2.11.1 association through mac address ............................................................. 248 3.5.2.12 receive checksum offloading .......................................................................... 248 3.5.3 transmit functionality ................................................................................................... 2 52 3.5.3.1 packet transmission ...................................................................................... 252 3.5.3.1.1 transmit data storage ............................................................................. 252 3.5.3.2 transmit contexts ......................................................................................... 252 3.5.3.3 transmit descriptors ...................................................................................... 253
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 19 3.5.3.3.1 description ............................................................................................. 253 3.5.3.3.1.1 legacy transmit descriptor format ........................................................ 253 3.5.3.3.1.2 advanced transmit context descriptor.................................................... 257 3.5.3.3.1.3 advanced transmit data descriptor ........................................................ 259 3.5.3.3.2 transmit descriptor structure ................................................................... 261 3.5.3.3.3 transmit descriptor fetching .................................................................... 263 3.5.3.3.4 transmit descriptor write-back ................................................................. 264 3.5.3.4 tcp segmentation ......................................................................................... 264 3.5.3.4.1 assumptions ........................................................................................... 264 3.5.3.4.2 transmission process ............................................................................... 264 3.5.3.4.2.1 tcp segmentation performance ............................................................. 265 3.5.3.4.3 packet format......................................................................................... 265 3.5.3.4.4 tcp segmentation indication .................................................................... 266 3.5.3.4.5 ip and tcp/udp headers .......................................................................... 267 3.5.3.4.6 transmit checksum offloading with tcp segmentation ................................. 272 3.5.3.4.7 ip/tcp/udp header updating .................................................................... 274 3.5.3.4.7.1 tcp/ip/udp header for the first frames .................................................. 274 3.5.3.4.7.2 tcp/ip/udp header for the subsequent frames ....................................... 274 3.5.3.4.7.3 tcp/ip/udp header for the last frame ................................................... 275 3.5.3.4.8 ip/tcp/udp checksum offloading .............................................................. 276 3.5.3.5 ip/tcp/udp transmit checksum offloading in non-segmentation mode ................ 277 3.5.3.5.1 ip checksum .......................................................................................... 277 3.5.3.5.2 tcp checksum ........................................................................................ 277 3.5.3.6 multiple transmit queues ............................................................................... 278 3.5.3.6.1 description ............................................................................................. 278 3.5.3.7 transmit completions head write back............................................................. 279 3.5.3.7.1 description ............................................................................................. 279 3.5.4 interrupts ................................................................................................................ .... 279 3.5.4.1 registers ...................................................................................................... 279 3.5.4.2 interrupt moderation ...................................................................................... 281 3.5.4.3 clearing interrupt causes ............................................................................... 283 3.5.4.4 dynamic interrupt moderation ......................................................................... 283 3.5.4.4.1 implementation ...................................................................................... 284 3.5.4.5 tcp timer interrupt ....................................................................................... 284 3.5.4.5.1 description ............................................................................................. 284 3.5.4.6 msi-x interrupts ........................................................................................... 284 3.5.5 802.1q vlan support .................................................................................................... 285 3.5.5.1 802.1q vlan packet format ............................................................................ 285 3.5.5.2 802.1q tagged frames ................................................................................... 286 3.5.5.3 transmitting and receiving 802.1q packets ....................................................... 286 3.5.5.3.1 adding 802.1q tags on transmits .............................................................. 286 3.5.5.3.2 stripping 802.1q tags on receives ............................................................ 287 3.5.5.4 802.1q vlan packet filtering .......................................................................... 287 3.5.6 dca ....................................................................................................................... ..... 288 3.5.6.1 description ................................................................................................... 288 3.5.6.2 pcie message format for dca (mwr mode) ....................................................... 290 3.5.7 led's..................................................................................................................... ...... 291 4. programming interface ........................................................................................................... 293 4.1 address regions ............................................................................................................. ........... 293 4.2 memory-mapped access ........................................................................................................ ...... 293 4.2.1 memory-mapped access to internal registers and memories ............................................... 293 4.2.2 memory-mapped accesses to flash .................................................................................. 293 4.2.3 memory-mapped access to expansion rom....................................................................... 294 4.3 i/o-mapped access ........................................................................................................... ......... 294 4.3.1 ioaddr (i/o offset 0x00, rw) ....................................................................................... 294 4.3.2 iodata (i/o offset 0x04, rw)........................................................................................ 294 4.3.3 undefined i/o offsets .................................................................................................... 2 95 4.4 device registers ............................................................................................................ ............ 296 4.4.1 terminology ............................................................................................................... .. 296
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 20 october 2010 4.4.2 register list ............................................................................................................. .... 296 4.4.3 register descriptions ..................................................................................................... 304 4.4.3.1 general control registers ............................................................................... 304 4.4.3.1.1 device control register ? ctrl (0x00000/0x00004, rw).............................. 304 4.4.3.1.2 device status register ? status (0x00008; r)........................................... 305 4.4.3.1.3 extended device control register ? ctrl_ext (0x00018; rw) ...................... 305 4.4.3.1.4 extended sdp control ? esdp (0x00020, rw)............................................. 306 4.4.3.1.5 extended od sdp control ? eodsdp (0x00028; rw) ................................... 307 4.4.3.1.6 led control ? ledctl (0x00200; rw) ....................................................... 308 4.4.3.1.7 tcp_timer - tcptimer (0x0004c, rw) ...................................................... 310 4.4.3.2 eeprom/flash registers ................................................................................. 310 4.4.3.2.1 eeprom/flash control register ? eec (0x10010; rw).................................. 310 4.4.3.2.2 eeprom read register ? eerd (0x10014; rw) ........................................... 313 4.4.3.2.3 flash access register ? fla (0x1001c; rw)................................................ 313 4.4.3.2.4 manageability eeprom control register ? eemngctl (0x10110; rw) ............ 314 4.4.3.2.5 manageability eeprom read/write data ? eemngdata (0x10114; rw) ......... 315 4.4.3.2.6 manageability flash control register ? flmngctl (0x10118; rw) ................. 315 4.4.3.2.7 manageability flash read data ? flmngdata (0x1011c; rw) ...................... 316 4.4.3.2.8 manageability flash read counter ? flmngcnt (0x10120; rw) .................... 316 4.4.3.2.9 flash opcode register ? flop (0x01013c; rw)........................................... 316 4.4.3.2.10 general receive control ? grc (0x10200; rw) ........................................... 317 4.4.3.3 interrupt registers ........................................................................................ 317 4.4.3.3.1 extended interrupt cause register eicr (0x00800, rc) ............................... 317 4.4.3.3.2 extended interrupt cause set register eics (0x00808, wo) ......................... 319 4.4.3.3.3 extended interrupt mask set/read register eims (0x00880, rws) ................ 319 4.4.3.3.4 extended interrupt mask clear register eimc (0x00888, wo) ....................... 320 4.4.3.3.5 extended interrupt auto clear register eiac (0x00810, rw)......................... 321 4.4.3.3.6 extended interrupt auto mask enable register ? eiam (0x00890, rw) ........... 322 4.4.3.3.7 extended interrupt throttle registers ? eitr (0x00820 ? 0x0086c, rw) ........ 322 4.4.3.3.8 interrupt vector allocation registers ivar (0x00900 + 4*n [n=0?24], rw).... 323 4.4.3.3.9 msi-x table - msixt (bar3: 0x00000 ? 0x0013c, rw)................................ 324 4.4.3.3.10 msi-x pending bit array ? msixpba (bar3: 0x02000, ro) ........................... 324 4.4.3.3.11 msi-x pending bit array clear ? pbacl (0x11068, rw) ................................ 324 4.4.3.3.12 general purpose interrupt enable ? gpie (0x00898, rw).............................. 325 4.4.3.4 flow control registers description ................................................................... 326 4.4.3.4.1 priority flow control type opcode ? pfctop (0x03008; rw)......................... 326 4.4.3.4.2 flow control transmit timer value n ? fcttvn (0x03200 + 4*n[n=0..3]; rw) 326 4.4.3.4.3 flow control receive threshold low ? fcrtl (0x03220 + 8*n[n=0..7]; rw)... 326 4.4.3.4.4 flow control receive threshold high ? fcrth (0x03260 + 8*n[n=0..7]; rw) . 327 4.4.3.4.5 flow control refresh threshold value ? fcrtv (0x032a0; rw) ..................... 328 4.4.3.4.6 transmit flow control status ? tfcs (0x0ce00; ro) ................................... 328 4.4.3.5 receive dma registers ................................................................................... 329 4.4.3.5.1 receive descriptor base address low ? rdbal (0x01000 + 0x40*n[n=0..63]; rw) 329 4.4.3.5.2 receive descriptor base address high ? rdbah (0x01004 + 0x40*n[n=0..63]; rw) 329 4.4.3.5.3 receive descriptor length ? rdlen (0x01008 + 0x40*n[n=0..63]; rw)......... 329 4.4.3.5.4 receive descriptor head ? rdh (0x01010 + 0x40*n[n=0..63]; ro)............... 329 4.4.3.5.5 receive descriptor tail ? rdt (0x01018 + 0x40*n[n=0..63]; rw) ................. 330 4.4.3.5.6 receive descriptor control ? rxdctl (0x01028 + 0x40*n[n=0..63]; rw) ...... 330 4.4.3.5.7 split receive control registers ? srrctl (0x02100 ? 0x0213c; rw) ............. 332 4.4.3.5.8 rx dca control register ? dca_rxctrl (0x02200 ? 0x0223c; rw) .............. 332 4.4.3.5.9 receive dma control register ? rdrxctl (0x02f00; rw) ............................ 333 4.4.3.5.10 receive packet buffer size ? rxpbsize (0x03c00 ? 0x03c1c; rw) ............... 334 4.4.3.5.11 receive control register ? rxctrl (0x03000; rw)...................................... 334 4.4.3.5.12 drop enable control ? dropen (0x03d04 ? 0x03d08; rw) .......................... 335 4.4.3.6 receive registers .......................................................................................... 335 4.4.3.6.1 receive checksum control ? rxcsum (0x05000; rw).................................. 335 4.4.3.6.2 receive filter control register ? rfctl (0x05008; rw) ................................ 336 4.4.3.6.3 multicast table array ? mta (0x05200-0x053fc; rw) .................................. 336
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 21 4.4.3.6.4 receive address low ? ral (0x05400 + 8*n[n=0..15]; rw) ......................... 337 4.4.3.6.5 receive address high ? rah (0x05404 + 8*n[n=0..15]; rw)........................ 337 4.4.3.6.6 packet split receive type register ? psrtype (0x05480 ? 0x054bc, rw)....... 338 4.4.3.6.7 vlan filter table array ? vfta (0x0a000-0x0a9fc; rw).............................. 339 4.4.3.6.8 filter control register ? fctrl (0x05080, rw)............................................ 341 4.4.3.6.9 vlan control register ? vlnctrl (0x05088, rw) ....................................... 343 4.4.3.6.10 multicast control register ? mcstctrl (0x05090, rw) ................................ 343 4.4.3.6.11 multiple receive queues command register mrqc (0x05818; rw) ................ 343 4.4.3.6.12 vmdq control register ? vmd_ctl (0x0581c; rw)...................................... 344 4.4.3.6.13 immediate interrupt rx imir (0x05a80 + 4*n[n=0..7], rw) ........................ 344 4.4.3.6.14 immediate interrupt rx extended imirext (0x05aa0 + 4*n[n=0..7], rw) ..... 345 4.4.3.6.15 immediate interrupt rx vlan priority register imirvp (0x05ac0, rw)........... 345 4.4.3.6.16 indirection table ? reta (0x05c00-0x0057c; rw) ...................................... 346 4.4.3.6.17 rss random key register ? rssrk (0x05c80-0x05ca4; rw)....................... 347 4.4.3.7 transmit register descriptions ........................................................................ 347 4.4.3.7.1 transmit descriptor base address low ? tdbal (0x06000 + n*0x40[n=0..31]; rw) 347 4.4.3.7.2 transmit descriptor base address high ? tdbah (0x06004 + n*0x40[n=0..31]; rw) 348 4.4.3.7.3 transmit descriptor length ? tdlen (0x06008 + n*0x40[n=0..31]; rw) ....... 348 4.4.3.7.4 transmit descriptor head ? tdh (0x06010 + n*0x40[n=0..31]; ro) ............. 348 4.4.3.7.5 transmit descriptor tail ? tdt (0x06018 + n*0x40[n=0..31]; rw) ............... 348 4.4.3.7.6 transmit descriptor control ? txdctl (0x06028 + n*0x40[n=0..31]; rw) ..... 349 4.4.3.7.7 tx descriptor completion write back address low ? tdwbal (0x06038 + n*0x40[n=0..31]; rw)............................................................................. 350 4.4.3.7.8 tx descriptor completion write back address high ? tdwbah (0x0603c + n*0x40[n=0..31]; rw)............................................................................. 350 4.4.3.7.9 dma tx control ? dtxctl (0x07e00; rw).................................................. 350 4.4.3.7.10 tx dca control register ? dca_txctrl (0x07200 ? 0x0723c; rw)............... 351 4.4.3.7.11 transmit ipg control ? tipg (0x0cb00; rw) .............................................. 351 4.4.3.7.12 transmit packet buffer size ? txpbsize (0x0cc00 ? 0x0cc1c; rw).............. 352 4.4.3.7.13 manageability transmit tc mapping ? mngtxmap (0x0cd10; rw)................. 352 4.4.3.8 wake-up control registers ............................................................................. 352 4.4.3.8.1 wake up control register ? wuc (0x05800; rw) ........................................ 352 4.4.3.8.2 wake up filter control register ? wufc (0x05808; rw)............................... 353 4.4.3.8.3 wake up status register ? wus (0x05810; ro) .......................................... 353 4.4.3.8.4 ip address valid ? ipav (0x5838; rw) ....................................................... 354 4.4.3.8.5 ipv4 address table ? ip4at (0x05840 + n*8 [n = 0..3]; rw) ....................... 355 4.4.3.8.6 ipv6 address table ? ip6at (0x05880-0x0588c; rw) .................................. 355 4.4.3.8.7 wake up packet length ? wupl (0x05900; r) ............................................ 356 4.4.3.8.8 wake up packet memory (128 bytes) ? wupm (0x05a00-0x05a7c; r) ........... 356 4.4.3.8.9 flexible host filter table registers ? fhft (0x09000 ? 0x093fc; rw) ............ 356 4.4.3.9 statistic registers .......................................................................................... 357 4.4.3.9.1 crc error count ? crcerrs (0x04000; r) ................................................. 358 4.4.3.9.2 illegal byte error count ? illerrc (0x04004; r)......................................... 358 4.4.3.9.3 error byte count ? errbc (0x04008; r) .................................................... 358 4.4.3.9.4 mac short packet discard count ? mspdc (0x04010; r) .............................. 358 4.4.3.9.5 missed packets count ? mpc (0x03fa0 ? 0x03fbc; r) ................................. 359 4.4.3.9.6 mac local fault count ? mlfc (0x04034; r)............................................... 359 4.4.3.9.7 mac remote fault count ? mrfc (0x04038; r) ........................................... 359 4.4.3.9.8 receive length error count ? rlec (0x04040; r) ........................................ 359 4.4.3.9.9 link xon transmitted count ? lxontxc (0x03f60; r)................................. 359 4.4.3.9.10 link xon received count ? lxonrxc (0x0cf60; r)..................................... 360 4.4.3.9.11 link xoff transmitted count ? lxofftxc (0x03f68; r) .............................. 360 4.4.3.9.12 link xoff received count ? lxoffrxc (0x0cf68; r) .................................. 360 4.4.3.9.13 priority xon transmitted count ? pxontxc (0x03f00 ? 0x03f1c; r)............. 360 4.4.3.9.14 priority xon received count ? pxonrxc (0x0cf00 ? 0x0cf1c; r) ................ 360 4.4.3.9.15 priority xoff transmitted count ? pxofftxc (0x03f20 ? 0x03f3c; r) .......... 361 4.4.3.9.16 priority xoff received count ? pxoffrxc (0x0cf20 ? 0x0cf2c; r) .............. 361 4.4.3.9.17 packets received (64 bytes) count ? prc64 (0x0405c; r) ........................... 361
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 22 october 2010 4.4.3.9.18 packets received (65-127 bytes) count ? prc127 (0x04060; r) ................... 361 4.4.3.9.19 packets received (128-255 bytes) count ? prc255 (0x04064; r).................. 362 4.4.3.9.20 packets received (256-511 bytes) count ? prc511 (0x04068; r).................. 362 4.4.3.9.21 packets received (512-1023 bytes) count ? prc1023 (0x0406c; r) .............. 362 4.4.3.9.22 packets received (1024 to max bytes) count ? prc1522 (0x04070; r) .......... 362 4.4.3.9.23 good packets received count ? gprc (0x04074; r) .................................... 363 4.4.3.9.24 broadcast packets received count ? bprc (0x04078; r) .............................. 363 4.4.3.9.25 multicast packets received count ? mprc (0x0407c; r) ............................... 363 4.4.3.9.26 good packets transmitted count ? gptc (0x04080; r) ................................ 363 4.4.3.9.27 good octets received count ? gorc (0x0408c; r) ..................................... 364 4.4.3.9.28 good octets transmitted count ? gotc (0x04094; r); ................................ 364 4.4.3.9.29 receive no buffers count ? rnbc (0x03fc0 ? 0x03fdc; r) .......................... 364 4.4.3.9.30 receive undersize count ? ruc (0x040a4; r) ............................................. 365 4.4.3.9.31 receive fragment count ? rfc (0x040a8; r).............................................. 365 4.4.3.9.32 receive oversize count ? roc (0x040ac; r) .............................................. 365 4.4.3.9.33 receive jabber count ? rjc (0x040b0; r) .................................................. 365 4.4.3.9.34 management packets received count ? mngprc (0x040b4; r) ..................... 366 4.4.3.9.35 management packets dropped count ? mngpdc (0x040b8; r)...................... 366 4.4.3.9.36 management packets transmitted count ? mngptc (0x0cf90; r) ................. 366 4.4.3.9.37 total octets received ? tor (0x040c4; r); ................................................ 366 4.4.3.9.38 total packets received ? tpr (0x040d0; r) ................................................ 367 4.4.3.9.39 total packets transmitted ? tpt (0x040d4; r)............................................ 367 4.4.3.9.40 packets transmitted (64 bytes) count ? ptc64 (0x040d8; r) ....................... 367 4.4.3.9.41 packets transmitted (65-127 bytes) count ? ptc127 (0x040dc; r)............... 367 4.4.3.9.42 packets transmitted (128-255 bytes) count ? ptc255 (0x040e0; r).............. 368 4.4.3.9.43 packets transmitted (256-511 bytes) count ? ptc511 (0x040e4; r).............. 368 4.4.3.9.44 packets transmitted (512-1023 bytes) count ? ptc1023 (0x040e8; r) .......... 368 4.4.3.9.45 packets transmitted (greater than 1024 bytes) count ? ptc1522 (0x040ec; r)368 4.4.3.9.46 multicast packets transmitted count ? mptc (0x040f0; r) ........................... 369 4.4.3.9.47 broadcast packets transmitted count ? bptc (0x040f4; r) .......................... 369 4.4.3.9.48 xsum error count ? xec (0x04120; ro) .................................................... 369 4.4.3.9.49 receive queue statistic mapping registers rqsmr (0x2300 + 4*n [n=0?15], rw) 369 4.4.3.9.50 transmit queue statistic mapping registers tqsmr (0x7300 + 4*n [n=0?7], rw) 370 4.4.3.9.51 queue packets received count ? qprc (0x01030+ n*0x40[n=0..15]; r) ....... 371 4.4.3.9.52 queue packets transmitted count ? qptc (0x06030 + n*0x40[n=0..15]; r) .. 371 4.4.3.9.53 queue bytes received count ? qbrc (0x1034 + n*0x40[n=0..15]; r)........... 371 4.4.3.9.54 queue bytes transmitted count ? qbtc (0x6034+n*0x40[n=0..15]; r)......... 372 4.4.3.10 management filter registers ........................................................................... 372 4.4.3.10.1 management vlan tag value ? mavtv (0x5010 +4*n[n=0..7]; rw)............. 372 4.4.3.10.2 management flex udp/tcp ports ? mfutp (0x5030 + 4*n[n=0..7]; rw) ........ 372 4.4.3.10.3 management control register ? manc (0x05820; rw) ................................. 372 4.4.3.10.4 manageability filters valid ? mfval (0x5824; rw) ....................................... 373 4.4.3.10.5 management control to host register ? manc2h (0x5860; rw) ................... 374 4.4.3.10.6 manageability decision filters- mdef (0x5890 + 4*n[n=0..7]; rw)................ 374 4.4.3.10.7 manageability ip address filter ? mipaf (0x58b0-0x58ec; rw) ..................... 376 4.4.3.10.8 manageability mac address low ? mmal (0x5910 + 8*n[n=0..3]; rw) .......... 379 4.4.3.10.9 manageability mac address high ? mmah (0x5914 + 8*n[n=0..3]; rw) ......... 379 4.4.3.10.10 flexible tco filter table registers ? ftft (0x09400-0x097fc; rw) ............... 379 4.4.3.11 pcie registers............................................................................................... 381 4.4.3.11.1 pcie control register ? gcr (0x11000; rw)............................................... 381 4.4.3.11.2 pcie timer value ? gtv (0x11004; rw)..................................................... 383 4.4.3.11.3 function-tag register functag (0x11008; rw) ......................................... 383 4.4.3.11.4 pcie latency timer ? glt (0x1100c; rw) .................................................. 384 4.4.3.11.5 function active and power state to manageability ? factps (0x10150; ro) .... 384 4.4.3.11.6 pcie analog configuration register ? pcieanactl (0x11040; rw) ................ 385 4.4.3.11.7 software semaphore register ? swsm (0x10140; rw) ................................ 385 4.4.3.11.8 firmware semaphore register ? fwsm (0x10148; rw) ................................ 386 4.4.3.11.9 general software semaphore register ? gssr (0x10160; rw)...................... 387
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 23 4.4.3.11.10 mirrored revision id- mrevid (0x11064; ro) ............................................. 390 4.4.3.12 dca control registers .................................................................................... 390 4.4.3.12.1 dca requester id information register- dca_id (0x11070; r) ..................... 390 4.4.3.12.2 dca control register- dca_ctrl (0x11074; rw) ........................................ 390 4.4.3.13 mac registers ............................................................................................... 391 4.4.3.13.1 pcs_1g global config register 1 ? pcs1gcfig (0x04200, rw) ..................... 391 4.4.3.13.2 pcg_1g link control register ? pcs1glctl (0x04208; rw) ......................... 391 4.4.3.13.3 pcs_1g link status register ? pcs1glsta (0x0420c; ro)........................... 392 4.4.3.13.4 pcs_1 gb/s auto negotiation advanced register pcs1gana (0x04218; rw)... 393 4.4.3.13.5 pcs_1gan lp ability register ? pcs1ganlp (0x0421c; ro) ......................... 393 4.4.3.13.6 pcs_1g auto negotiation next page transmit register ? pcs1gannp (0x04220; rw) 394 4.4.3.13.7 pcs_1g auto negotiation lp's next page register ? pcs1ganlpnp (0x04224; ro) 395 4.4.3.13.8 flow control 0 register ? hlreg0 (0x04240, rw) ...................................... 396 4.4.3.13.9 flow control status 1 register- hlreg1 (0x04244, ro) ............................... 397 4.4.3.13.10 pause and pace register ? pap (0x04248, rw)............................................ 398 4.4.3.13.11 mdi auto-scan command and address ? maca (0x0424c; rw) .................... 399 4.4.3.13.12 auto-scan phy address enable ? apae (0x04250; rw) ................................ 399 4.4.3.13.13 auto-scan read data ? ard (0x04254; rw) ............................................... 399 4.4.3.13.14 auto-scan interrupt status ? ais (0x04258; rw) ........................................ 400 4.4.3.13.15 mdi single command and address ? msca (0x0425c; rw) .......................... 400 4.4.3.13.16 mdi single read and write data ? msrwd (0x04260; rw)........................... 401 4.4.3.13.17 low mac address ? mladd (0x04264; rw) ................................................ 401 4.4.3.13.18 mac address high and max frame size ? mhadd (0x04268; rw).................. 401 4.4.3.13.19 xgxs status 1 ? pcss1 (0x4288; ro) ....................................................... 401 4.4.3.13.20 xgxs status 2 ? pcss2 (0x0428c; ro) ..................................................... 402 4.4.3.13.21 10gbase-x pcs status ? xpcss (0x04290; ro) ......................................... 402 4.4.3.13.22 serdes interface control register ? serdesc (0x04298; rw)....................... 404 4.4.3.13.23 fifo status/cntl report register ? macs (0x0429c; rw) ........................... 405 4.4.3.13.24 auto negotiation control register ? autoc (0x042a0; rw) .......................... 405 4.4.3.13.25 link status register ? links (0x042a4; ro) .............................................. 407 4.4.3.13.26 auto negotiation control 2 register ? autoc2 (0x042a8; rw)...................... 408 4.4.3.13.27 auto negotiation control 3 register ? autoc3 (0x042ac; rw)...................... 409 4.4.3.13.28 auto negotiation link partner link control word 1 register ? anlp1 (0x042b0; ro) 409 4.4.3.13.29 auto negotiation link partner link control word 2 register ? anlp2 (0x042b4; ro) 410 4.4.3.13.30 mac manageability control register ? mmngc (0x042d0; host-ro/mng-rw) . 410 4.4.3.13.31 auto negotiation link partner next page 1 register ? anlpnp1 (0x042d4; ro)411 4.4.3.13.32 auto negotiation link partner next page 2 register ? anlpnp2 (0x042d8; ro)411 4.4.3.13.33 core analog configuration register - atlasctl (0x04800; rw) .................... 411 5. system manageability .............................................................................................................. 413 5.1 pass-through (pt) functionality ............................................................................................. ...... 413 5.2 components of a sideband interface .......................................................................................... .. 414 5.3 smbus pass-through interface................................................................................................ ..... 415 5.3.1 general ................................................................................................................... .... 415 5.3.2 pass-through capabilities .............................................................................................. 415 5.3.2.1 packet filtering ............................................................................................. 415 5.3.3 pass-through multi-port modes ....................................................................................... 416 5.3.3.1 automatic ethernet arp operation ................................................................... 416 5.3.3.2 manageability receive filtering ........................................................................ 416 5.3.3.2.1 overview and general structure ................................................................ 416 5.3.3.2.2 l2 layer filtering .................................................................................... 418 5.3.3.2.2.1 vlan filtering...................................................................................... 419 5.3.3.2.3 manageability decision filtering................................................................. 420 5.3.3.2.3.1 l3 & l4 filters ..................................................................................... 421 5.3.3.2.4 manageability decision filters.................................................................... 422 5.3.4 smbus transactions ...................................................................................................... 42 5
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 24 october 2010 5.3.4.1 smbus addressing ......................................................................................... 426 5.3.4.2 smbus arp functionality ................................................................................ 426 5.3.4.2.1 smbus arp flow...................................................................................... 426 5.3.4.2.2 smbus arp udid content......................................................................... 428 5.3.4.2.3 smbus arp in dual/single mode ................................................................ 430 5.3.4.3 concurrent smbus transactions....................................................................... 430 5.3.5 smbus notification methods ............................................................................................ 430 5.3.5.1 smbus alert and alert response method ........................................................... 431 5.3.5.2 asynchronous notify method ........................................................................... 432 5.3.5.3 direct receive method .................................................................................... 432 5.3.6 1 mhz smbus support ................................................................................................... 433 5.3.7 receive tco flow.......................................................................................................... 433 5.3.8 transmit tco flow ........................................................................................................ 4 33 5.3.8.1 transmit errors in sequence handling .............................................................. 434 5.3.8.2 tco command aborted flow ........................................................................... 435 5.3.9 smbus arp transactions ................................................................................................ 435 5.3.9.1 prepare to arp .............................................................................................. 435 5.3.9.2 reset device (general)................................................................................... 435 5.3.9.3 reset device (directed) .................................................................................. 436 5.3.9.4 assign address .............................................................................................. 436 5.3.9.5 get udid (general and directed)..................................................................... 437 5.3.10 smbus pass-through transactions................................................................................... 439 5.3.10.1 write transactions ......................................................................................... 439 5.3.10.1.1 transmit packet command ....................................................................... 439 5.3.10.1.2 request status command ........................................................................ 439 5.3.10.1.3 receive enable command......................................................................... 440 5.3.10.1.3.1 management mac address (data bytes 7:2) ............................................ 442 5.3.10.1.3.2 management ip address (data bytes 11:8).............................................. 442 5.3.10.1.3.3 asynchronous notification smbus address (data byte 12).......................... 442 5.3.10.1.3.4 interface data (data byte 13)................................................................ 442 5.3.10.1.3.5 alert value data (data byte 14) ............................................................. 442 5.3.10.1.4 force tco command ............................................................................... 442 5.3.10.1.5 management control................................................................................ 443 5.3.10.1.6 update management receive filter parameters............................................ 444 5.3.10.2 read transactions (82598 to bmc) .................................................................. 446 5.3.10.2.1 receive tco lan packet transaction.......................................................... 447 5.3.10.2.1.1 receive tco lan status payload transaction ........................................... 448 5.3.10.2.2 read status command............................................................................. 451 5.3.10.2.3 get system mac address ......................................................................... 455 5.3.10.2.4 read configuration .................................................................................. 455 5.3.10.2.5 read management parameters .................................................................. 456 5.3.10.2.6 read management receive filter parameters .............................................. 456 5.3.10.2.7 read receive enable configuration ............................................................ 458 5.3.11 lan fail-over in lan teaming mode ................................................................................ 459 5.3.11.1 fail-over functionality.................................................................................... 459 5.3.11.1.1 transmit functionality.............................................................................. 459 5.3.11.1.2 receive functionality ............................................................................... 459 5.3.11.1.3 port switching (fail-over)......................................................................... 459 5.3.11.1.4 device driver interactions ........................................................................ 460 5.3.11.2 fail-over configuration................................................................................... 460 5.3.11.2.1 preferred primary port ............................................................................. 460 5.3.11.2.2 gratuitous arps ...................................................................................... 460 5.3.11.2.3 link down timeout .................................................................................. 460 5.3.11.3 fail-over register .......................................................................................... 460 5.3.12 smbus troubleshooting guide ......................................................................................... 461 5.3.12.1 tco alert line stays asserted after a power cycle ............................................. 462 5.3.12.2 smbus commands are always nack'd by the 82598 .......................................... 462 5.3.12.3 smbus clock speed is 16.6666 khz.................................................................. 462 5.3.12.4 a network based host application is not receiving any network packets ............... 463 5.3.12.5 status registers ............................................................................................ 463
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 25 5.3.12.5.1 firmware semaphore register (fwsm, 0x10148) ........................................ 463 5.3.12.5.2 management control register (manc 0x5820) ............................................ 463 5.3.12.5.3 management control to host register (manc2h 0x5860) ............................. 464 5.3.12.6 unable to transmit packets from the bmc ......................................................... 464 5.3.12.7 smbus fragment size..................................................................................... 464 5.3.12.8 enable xsum filtering .................................................................................... 465 5.3.12.9 still having problems? .................................................................................... 465 5.3.13 sample configurations ................................................................................................... 4 65 5.4 nc-si interface ............................................................................................................. ............ 475 5.4.1 overview .................................................................................................................. ... 475 5.4.1.1 terminology.................................................................................................. 475 5.4.1.2 system topology ........................................................................................... 477 5.4.1.3 data transport .............................................................................................. 478 5.4.1.3.1 control frames ....................................................................................... 478 5.4.1.3.2 nc-si frames receive flow ...................................................................... 479 5.4.2 nc-si support ............................................................................................................. . 479 5.4.2.1 supported features ....................................................................................... 479 5.4.2.2 nc-si mode - intel specific commands............................................................. 484 5.4.2.2.1 overview................................................................................................ 484 5.4.2.2.1.1 oem command (0x50).......................................................................... 485 5.4.2.2.1.2 oem response (0xd0) .......................................................................... 485 5.4.2.2.1.3 oem specific command response reason codes ...................................... 486 5.4.2.2.2 proprietary commands format .................................................................. 487 5.4.2.2.2.1 set intel filters control command (intel command 0x00) ......................... 487 5.4.2.2.2.2 set intel filters control response format (intel command 0x00) ............... 488 5.4.2.2.3 set intel filters control - ip filters control command (intel command 0x00, filter control index 0x00) ................................................................................. 488 5.4.2.2.3.1 set intel filters control - ip filters control response (intel command 0x00, filter control index 0x00) ............................................................................. 489 5.4.2.2.4 get intel filters control command (intel command 0x01) ............................ 489 5.4.2.2.4.1 get intel filters control - ip filters control command (intel command 0x01, filter control index 0x00) ............................................................................. 489 5.4.2.2.4.2 get intel filters control - ip filters control response (intel command 0x01, filter control index 0x00) ............................................................................. 490 5.4.2.2.5 set intel filters formats ........................................................................... 490 5.4.2.2.5.1 set intel filters command (intel command 0x02) .................................... 490 5.4.2.2.5.2 set intel filters response (intel command 0x02) ..................................... 490 5.4.2.2.5.3 set intel filters - manageability to host command (intel command 0x02, filter parameter 0x0a) .................................................................................. 491 5.4.2.2.5.4 set intel filters - manageability to host response (intel command 0x02, filter parameter 0x0a) .................................................................................. 491 5.4.2.2.5.5 set intel filters - flex filter 0 enable mask and length command (intel command 0x02, filter parameter 0x10/0x20/0x30/0x40) ......................................... 492 5.4.2.2.5.6 set intel filters - flex filter 0 enable mask and length response (intel command 0x02, filter parameter 0x10/0x20/0x30/0x40) ......................................... 492 5.4.2.2.5.7 set intel filters - flex filter 0 data command (intel command 0x02, filter parameter 0x11/0x21/0x31/0x41).......................................................... 493 5.4.2.2.5.8 set intel filters - flex filter 0 data response (intel command 0x02, filter parameter 0x11/0x21/0x31/0x41).......................................................... 493 5.4.2.2.5.9 set intel filters - packet addition decision filter command (intel command 0x02, filter parameter 0x61) .......................................................................... 493 5.4.2.2.5.10 set intel filters - packet addition decision filter response (intel command 0x02, filter parameter 0x61) .......................................................................... 495 5.4.2.2.5.11 set intel filters - flex tcp/udp port filter command (intel command 0x02, filter parameter 0x63) .................................................................................. 495 5.4.2.2.5.12 set intel filters - flex tcp/udp port filter response (intel command 0x02, filter parameter 0x63) .................................................................................. 496 5.4.2.2.5.13 set intel filters - ipv4 filter command (intel command 0x02, filter parameter 0x64) ................................................................................................. 496
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 26 october 2010 5.4.2.2.5.14 set intel filters - ipv4 filter response (intel command 0x02, filter parameter 0x64) ................................................................................................. 496 5.4.2.2.5.15 set intel filters - ipv6 filter command (intel command 0x02, filter parameter 0x65) ................................................................................................. 497 5.4.2.2.5.16 set intel filters - ipv6 filter response (intel command 0x02, filter parameter 0x65) ................................................................................................. 498 5.4.2.2.6 get intel filters formats........................................................................... 498 5.4.2.2.6.1 get intel filters command (intel command 0x03) .................................... 498 5.4.2.2.6.2 get intel filters response (intel command 0x03) ..................................... 498 5.4.2.2.6.3 get intel filters - manageability to host command (intel command 0x03, filter parameter 0x0a) .................................................................................. 498 5.4.2.2.6.4 get intel filters - manageability to host response (intel command 0x03, filter parameter 0x0a) .................................................................................. 499 5.4.2.2.6.5 get intel filters - flex filter 0 enable mask and length command (intel command 0x03, filter parameter 0x10/0x20/0x30/0x40) ......................................... 499 5.4.2.2.6.6 get intel filters - flex filter 0 enable mask and length response (intel command 0x03, filter parameter 0x10/0x20/0x30/0x40) ......................................... 500 5.4.2.2.6.7 get intel filters - flex filter 0 data command (intel command 0x03, filter parameter 0x11/0x21/0x31/0x41).......................................................... 500 5.4.2.2.6.8 get intel filters - flex filter 0 data response (intel command 0x03, filter parameter 0x11) .................................................................................. 501 5.4.2.2.6.9 get intel filters - packet addition decision filter command (intel command 0x03, filter parameter 0x61) .......................................................................... 501 5.4.2.2.6.10 get intel filters - packet addition decision filter response (intel command 0x03, filter parameter 0x0a) .......................................................................... 502 5.4.2.2.6.11 get intel filters - flex tcp/udp port filter command (intel command 0x03, filter parameter 0x63) .................................................................................. 502 5.4.2.2.6.12 get intel filters - flex tcp/udp port filter response (intel command 0x03, filter parameter 0x63) .................................................................................. 502 5.4.2.2.6.13 get intel filters - ipv4 filter command (intel command 0x03, filter parameter 0x64) ................................................................................................. 503 5.4.2.2.6.14 get intel filters - ipv4 filter response (intel command 0x03, filter parameter 0x64) ................................................................................................. 503 5.4.2.2.6.15 get intel filters - ipv6 filter command (intel command 0x03, filter parameter 0x65) ................................................................................................. 503 5.4.2.2.6.16 get intel filters - ipv6 filter response (intel command 0x03, filter parameter 0x65) ................................................................................................. 504 5.4.2.2.7 set intel packet reduction filters formats .................................................. 504 5.4.2.2.7.1 set intel packet reduction filters command (intel command 0x04) ........... 504 5.4.2.2.7.2 set intel packet reduction filters response (intel command 0x04) ............ 504 5.4.2.2.7.3 set unicast packet reduction command (intel command 0x04, reduction filter index 0x00) ........................................................................................ 505 5.4.2.2.7.4 set unicast packet reduction response (intel command 0x04, reduction filter index 0x00) ........................................................................................ 507 5.4.2.2.7.5 set multicast packet reduction command (intel command 0x04, reduction filter index 0x01) ........................................................................................ 507 5.4.2.2.7.6 set multicast packet reduction response (intel command 0x04, reduction filter index 0x01) ........................................................................................ 509 5.4.2.2.7.7 set broadcast packet reduction command (intel command 0x04, reduction filter index 0x02) ........................................................................................ 509 5.4.2.2.7.8 set broadcast packet reduction response (intel command 0x08) .............. 511 5.4.2.2.8 get intel packet reduction filters formats .................................................. 511 5.4.2.2.8.1 get intel packet reduction filters command (intel command 0x05) ........... 511 5.4.2.2.8.2 set intel packet reduction filters response (intel command 0x05) ............ 512 5.4.2.2.8.3 get unicast packet reduction command (intel command 0x05, reduction filter index 0x00) ........................................................................................ 512 5.4.2.2.8.4 get unicast packet reduction response (intel command 0x05, reduction filter index 0x00) ........................................................................................ 512 5.4.2.2.8.5 get multicast packet reduction command (intel command 0x05, reduction filter index 0x01) ........................................................................................ 513
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 27 5.4.2.2.8.6 get multicast packet reduction response (intel command 0x05, reduction filter index 0x01) ........................................................................................ 513 5.4.2.2.8.7 get broadcast packet reduction command (intel command 0x05, reduction filter index 0x02) ........................................................................................ 513 5.4.2.2.8.8 get broadcast packet reduction response (intel command 0x05, reduction filter index 0x02) ........................................................................................ 514 5.4.2.2.9 system mac address ............................................................................... 514 5.4.2.2.9.1 get system mac address command (intel command 0x06) ...................... 514 5.4.2.2.9.2 get system mac address response (intel command 0x06) ....................... 514 5.4.2.2.10 set intel management control formats....................................................... 515 5.4.2.2.10.1 set intel management control command (intel command 0x20) ................ 515 5.4.2.2.10.2 set intel management control response (intel command 0x20)................. 515 5.4.2.2.11 get intel management control formats ...................................................... 516 5.4.2.2.11.1 get intel management control command (intel command 0x21)................ 516 5.4.2.2.11.2 get intel management control response (intel command 0x21) ................ 516 5.4.2.2.12 tco reset .............................................................................................. 516 5.4.2.2.12.1 perform intel tco reset command (intel command 0x22) ........................ 516 5.4.2.2.12.2 perform intel tco reset response (intel command 0x22)......................... 517 5.4.2.2.13 checksum offloading ............................................................................... 517 5.4.2.2.13.1 enable checksum offloading command (intel command 0x23) .................. 517 5.4.2.2.13.2 enable checksum offloading response (intel command 0x23) ................... 517 5.4.2.2.13.3 disable checksum offloading command (intel command 0x24) ................. 518 5.4.2.2.13.4 disable checksum offloading response (intel command 0x24) .................. 518 5.4.3 basic nc-si workflows................................................................................................... 51 8 5.4.3.1 package states.............................................................................................. 518 5.4.3.2 channel states .............................................................................................. 518 5.4.3.3 discovery ..................................................................................................... 519 5.4.3.4 configurations............................................................................................... 519 5.4.3.4.1 nc capabilities advertisement................................................................... 519 5.4.3.4.2 receive filtering...................................................................................... 519 5.4.3.4.2.1 mac address filtering ........................................................................... 520 5.4.3.4.2.2 vlan .................................................................................................. 520 5.4.3.5 pass-through traffic states ............................................................................ 521 5.4.3.5.1 channel enable ....................................................................................... 521 5.4.3.5.2 network transmit enable.......................................................................... 521 5.4.3.6 asynchronous event notifications..................................................................... 521 5.4.3.7 querying active parameters ............................................................................ 522 5.4.4 resets .................................................................................................................... ..... 522 5.4.5 advanced workflows...................................................................................................... 52 2 5.4.5.1 multi-nc arbitration ....................................................................................... 522 5.4.5.1.1 package selection sequence example ........................................................ 523 5.4.5.2 external link control...................................................................................... 524 5.4.5.2.1 set link while lan pcie functionality is disabled ........................................ 524 5.4.5.3 multiple channels (fail-over) .......................................................................... 524 5.4.5.3.1 fail-over algorithm example..................................................................... 525 5.4.5.4 statistics ...................................................................................................... 525 6 mechanical specification ......................................................................................................... 527 6.1 package information......................................................................................................... .......... 527 7 electrical specifications ........................................................................................................... 529 7.1 operating conditions ........................................................................................................ .......... 529 7.2 absolute maximum ratings.................................................................................................... ...... 529 7.3 recommended operating conditions............................................................................................ . 530 7.4 power delivery.............................................................................................................. ............. 530 7.4.1 power supply specifications............................................................................................ 530 7.4.2 power supply sequencing .............................................................................................. 532 7.4.3 power consumption....................................................................................................... 53 4 7.5 dc specifications ........................................................................................................... ............ 536 7.5.1 digital i/o ............................................................................................................... ..... 536
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 28 october 2010 7.5.2 open drain i/o ............................................................................................................ . 537 7.5.3 nc-si i/o ................................................................................................................. ... 537 7.6 digital i/f ac specifications ............................................................................................... .......... 538 7.6.1 digital i/o ac specification............................................................................................. 5 38 7.6.2 eeprom ac specifications .............................................................................................. 540 7.6.3 flash ac specification .................................................................................................... 541 7.6.4 smbus ac specification.................................................................................................. 54 4 7.6.5 nc-si ac specification................................................................................................... 5 45 7.6.6 reset signals............................................................................................................. ... 547 7.6.6.1 por_bypass (external) ................................................................................. 548 7.6.7 pcie dc/ac specification ............................................................................................... 548 7.6.7.1 pcie specification (receiver and transmitter).................................................... 548 7.6.7.2 pcie specification (input clock)....................................................................... 548 7.6.8 reference clock specification.......................................................................................... 548 8 design guidelines .................................................................................................................... 551 8.1 connecting the pcie interface ............................................................................................... ....... 551 8.1.1 link width configuration ................................................................................................ 55 1 8.1.2 polarity inversion and lane reversal................................................................................ 551 8.1.3 pcie reference clock..................................................................................................... 5 51 8.1.4 bias resistor ............................................................................................................. ... 552 8.1.5 miscellaneous pcie signals ............................................................................................. 552 8.2 connecting the maui interfaces .............................................................................................. ..... 552 8.3 maui channels lane connections .............................................................................................. ... 552 8.3.1 bias resistor ............................................................................................................. ... 552 8.3.2 xaui, kx/kx4, cx4 and bx layout recommendations........................................................ 552 8.3.2.1 board stack up example................................................................................. 552 8.3.2.2 trace geometries .......................................................................................... 553 8.3.2.3 other high-speed signal routing practices........................................................ 554 8.3.2.4 via usage ..................................................................................................... 555 8.3.2.5 reference planes ........................................................................................... 556 8.3.2.6 dielectric weave compensation ....................................................................... 557 8.3.2.7 impedance discontinuities .............................................................................. 557 8.3.2.8 reducing circuit inductance ............................................................................ 557 8.3.2.9 signal isolation ............................................................................................. 557 8.3.2.10 power and ground planes ............................................................................... 558 8.4 connecting the serial eeprom ................................................................................................ ..... 558 8.4.1 supported eeprom devices ............................................................................................ 558 8.4.2 eeupdate.................................................................................................................. .. 559 8.5 connecting the flash ........................................................................................................ .......... 559 8.5.1 supported eeprom devices............................................................................................ 559 8.6 connecting the manageability interfaces ..................................................................................... .. 560 8.6.1 connecting the smbus interface...................................................................................... 560 8.6.2 connecting the nc-si interface....................................................................................... 560 8.6.3 nc-si electrical interface requirements ........................................................................... 561 8.6.3.1 external baseboard management controller (bmc) ............................................. 561 8.6.3.2 nc-si reference schematic ............................................................................ 561 8.7 resets ...................................................................................................................... ............ 563 8.8 nc-si layout requirements................................................................................................... ...... 563 8.8.1 board impedance.......................................................................................................... 5 63 8.8.2 trace length restrictions ............................................................................................... 56 3 8.8.3 special delay requirements ........................................................................................... 565 8.9 connecting the mdio interfaces.............................................................................................. ..... 565 8.10 connecting the software-definable pins (sdps) .............................................................................. 565 8.11 connecting the light emitting diodes for designs based on the 82598 controller ................................ 566 8.12 connecting the miscellaneous signals....................................................................................... ..... 566 8.12.1 lan disable.............................................................................................................. .... 566 8.12.2 bios handling of device disable ..................................................................................... 568 8.12.3 phy disable and device power down signals .................................................................... 568 8.13 oscillator design considerations........................................................................................... ........ 568
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 29 8.13.1 oscillator types ......................................................................................................... ... 568 8.13.1.1 fixed crystal oscillator ................................................................................... 568 8.13.1.2 programmable crystal oscillators..................................................................... 569 8.13.2 oscillator solution ...................................................................................................... ... 569 8.13.3 oscillator layout recommendations................................................................................. 570 8.13.4 reference clock measurement recommendations .............................................................. 570 8.14 power supplies ............................................................................................................. ............. 570 8.14.1 power supply sequencing .............................................................................................. 570 8.14.1.1 using regulators with enable pins ................................................................... 571 8.14.2 power supply filtering ................................................................................................... 571 8.14.3 support for power management and wake up ................................................................... 571 8.15 connecting the jtag port ................................................................................................... ......... 572 8.16 thermal design considerations .............................................................................................. ...... 572 8.16.1 importance of thermal management................................................................................ 572 8.16.2 packaging terminology .................................................................................................. 57 2 8.16.3 thermal specifications ................................................................................................... 573 8.16.3.1 case temperature ......................................................................................... 574 8.16.4 thermal attributes ....................................................................................................... . 574 8.16.4.1 typical system definition................................................................................ 574 8.16.4.2 package mechanical attributes......................................................................... 574 8.16.4.3 package thermal characteristics...................................................................... 574 8.16.5 thermal enhancements.................................................................................................. 576 8.16.5.1 clearances.................................................................................................... 576 8.16.5.2 default enhanced thermal solution .................................................................. 577 8.16.5.3 extruded heatsinks ........................................................................................ 577 8.16.5.3.1 attaching the extruded heatsink................................................................ 578 8.16.5.3.1.1 clips................................................................................................... 578 8.16.5.3.1.2 thermal interface (pcm45 series) .......................................................... 578 8.16.5.4 thermal considerations for board design .......................................................... 578 8.16.5.4.1 reliability ............................................................................................... 579 8.16.5.5 thermal interface management for heat-sink solutions ...................................... 579 8.16.5.5.1 bond line management ............................................................................ 579 8.16.5.5.2 interface material performance.................................................................. 579 8.16.5.5.3 thermal resistance of the material ............................................................ 580 8.16.5.5.4 wetting/filling characteristics of the material .............................................. 580 8.16.6 measurements for thermal specifications ......................................................................... 580 8.16.6.1 case temperature measurements .................................................................... 580 8.16.6.2 attaching the thermocouple (no heatsink)........................................................ 580 8.16.6.3 attaching the thermocouple (heatsink) ............................................................ 581 8.16.7 heatsink and attach suppliers......................................................................................... 582 8.16.8 phy suppliers ............................................................................................................ ... 582 9. diagnostic registers ................................................................................................................ 583 9.1 register summary ........................................................................................................... .......... 583 9.1.1 ghost ecc register - gheccr (0x110b0, rw) ................................................................ 583 10. models, symbols, testing options, schematics and checklists ................................................. 585 10.1 models and symbols ......................................................................................................... .......... 585 10.2 physical layer conformance testing ......................................................................................... .... 585 10.3 schematics ................................................................................................................. .............. 585 10.4 checklists ................................................................................................................. ................ 585
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 30 october 2010 note: this page intentionally left blank.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 31 1. general information 1.1 introduction the intel ? 82598 10 gbe controller is a single, compact, low-power component with two fully integrated gigabit ethernet media access control (mac) and xaui ports. the 82598 supports 10gbase-kx4/1000base-kx as in ieee 802.3ap and cx4 (802.3ak). ports also contain a serializer-deserializer (designated ?bx?) to support 1000base-sx/lx (optical fiber) and gbe backplane applications. cx4 and xaui interfaces are also supported. in addition to managing mac and phy ethernet layer functions, the controller manages pcie packet traffic across its transaction, link, and physical/logical layers. the 82598 supports intel?s input/output acceleration technology (i/oat) v2.0. in addition, virtual queues are supported by i/o virtualization. the 82598?s on-board system management bus (smbus) and network controller sideband interface (nc-si) ports enable network manageability implementations. with smbus, management packets can be routed to or from a management processor. smbus ports enable industry standards, such as intelligent platform management interface (ipmi). nc-si ports enable support for the industry dmtf standard. the 82598, with pcie architecture, is designed for high-performance and low host-memory access latency. the 82598 connects directly to a system memory control hub (mch) or i/o controller hub (ich) using one, two, four, or eight pcie lanes. wide internal data paths eliminate performance bottlenecks by handling large address and data words. combining a parallel and pipelined logic architecture optimized for ethernet and independent transmit and receive queues, the 82598 efficiently handles packets with minimum latency. the 82598 includes advanced interrupt handling features. it uses efficient ring buffer descriptor data structures, with 32 tx queues and 64 rx queues. large on-chip buffers maintain superior performance. in addition, using hardware acceleration, the 82598 offloads tasks from the host, such as tcp/udp/ip checksum calculations and tcp segmentation. the 82598 package is a 31 mm x 31 mm, 883-ball, 1.0 mm ball pitch, flip-chip ball grid array (fcbga). 1.2 terminology and acronyms acronym description ack acknowledge. ara smbus alert response address. arp address resolution protocol.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 32 october 2010 asf alert standard format. the manageability protocol specification defined by the dmtf. b/w bandwidth. bmc baseboard manageability controller. the general name for an external tco controller, relevant only in tco mode. cml current mode logic. csr control and status register. usually refers to a hardware register. dca direct cache access. dft design for testability. dhcp dynamic host configuration protocol. a tcp/ip protocol that enables a client to receive a temporary ip address over the network from a remote server. dmtf the international organization responsible for managing and maintaining the asf specification. fw firmware. also known as embedded software. gpio general purpose i/o. hw hardware. ieee institute of electrical and electronics engineers. ip internet protocol. the protocol within tcp/ip that governs the breakup and reassembly of data messages into packets and the packet routing within the network. ip address the 4-byte or 16-byte address that designates the ethernet controller within the ip communication protocol. this address is dynamic and can be updated frequently during runtime. ipc inter-processor communication. ipmi intelligent platform management interface specification. lan local area network. also known as the ethernet. lom lan on motherboard. mac media access controller. mac address the 6-byte address that designates ethernet controller within the ethernet protocol. this address is constant and unique per ethernet controller. maui medium attachment unit interface. mdio management data input/output interface. na not applicable. nack not acknowledged. nc-si network controller sideband interface. nic network interface card. generic name for a ethernet controller that resides on a printed circuit board (pcb). acronym description
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 33 1.3 reference documents this application assumes that the designer is acquainted with high-speed design and board layout techniques. the following provide additional information: os operating system. usually designates the pc system?s software. pcs physical coding sub-layer. pec the smbus checksum signature, sent at the end of an smbus packet. an smbus device can be configured either to require or not require this signature. pet platform event trap. phy physical layer device. pma physical medium attachment. pmd physical medium dependent. psa smbus persistent slave address device. in the smbus 2.0 specification, this designates an smbus device whose address is stored in non-volatile memory. pt pass through. also known as tco mode. rmcp remote management and control protocol. rsp rmcp security extensions protocol. sa security association. serdes serializer and deserializer circuit. sfd start frame delimiter. smbus system management bus. snmp simple network management protocol. sw software. tbd to be defined. tco total cost of ownership. vpd vital product data (pci protocol). wwdm wide wave division multiplexing. xaui 10 gigabit attachment unit interface. xfp 10 gigabit small form factor pluggable modules. xgmii 10 gigabit media independent interface. xgxs xgmii extender sub-layer. acronym description
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 34 october 2010 ? 10gbase-x ? an ieee 802.3 physical coding sublayer for 10 gb/s operation over xaui and four lane pmds as per ieee 802.3 clause 48 ? 1000base-cx ? 1000base-x over specialty shielded 150 ohm balanced copper jumper cable assemblies as specified in ieee 802.3 clause 39 ? 10gbase-lx4 ? eee 802.3 physical layer specification for 10gb/s using 10gbase-x encoding over four wwdm lanes over multimode fiber as specified in ieee 802.3 clause 54 ? 10gbase-cx4 ? eee 802.3 physical layer specification for 10gb/s using 10gbase-x encoding over four lanes of 100 ohm shielded balanced copper cabling as specified in ieee 802.3 clause 54 ? 1000base-kx ? ieee 802.3 physical layer specification for 1gb/s using 1000base-x encoding over an electrical backplane as specified in ieee 802.3 clause 70 ? 10gbase-kx4 ? ieee 802.3 physical layer specification for 10gb/s using 10gbase-x encoding over an electrical backplane as specified in ieee 802.3 clause 71 ? 10gbase-kr ? ieee 802.3 physical layer specification for 10gb/s using 10gbase-r encoding over an electrical backplane as specified in ieee 802.3 clause 72 ? 1000base-bx ? 1000base-bx is the picmg 3.1 electrical specification for transmission of 1gb/s ethernet or 1gb/s fibre channel encoded data over the backplane ? 10gbase-bx4 ? 10gbase-bx4 is the picmg 3.1 electrical specification for transmission of the 10gb/s xaui signaling for a backplane environment ? 10gbase-t ? ieee 802.3 physical layer specification for a 10 gb/s lan using four pairs of class e or class f balanced twisted pair copper cabling as specified in ieee 802.3 clause 55 ? ieee standard 802.3, 2002 edition (ethernet). incorporates various ieee standards previously published separately. institute of electrical and electronic engineers (ieee). ? ieee standard 802.3ap draft d2.2 ? ieee standard 1149.1, 2001 edition (jtag). institute of electrical and electronics engineers (ieee) ? picmg3.1 ethernet/fibre channel over picmg 3.0 draft specification january 14, 2003 version d1.0 ? pci express* specification v2.0 (2.5 gt/s) ? pci specification, version 3.0 ? ipv4 specification (rfc 791) ? ipv6 specification (rfc 2460) ? tcp/udp specification (rfc 793/768) ? arp specification (rfc 826) ? ieee standard 802.1q for vlan ? ietf internet draft, marker pdu aligned framing for tcp specification ? ietf internet draft, direct data placement over reliable transports ? system management bus (smbus) specification, sbs implementers forum, ver. 2.0, august 2000 ? advanced configuration and power interface specification, rev 2.0b, october 2002 ? pci bus power management interface specification, rev. 1.2, march 2004
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 35 ? eui-64 specification, http://standards.ieee.org/regauth/oui/tutorials/eui64.html. ? 82563eb/82564eb gigabit ethernet physical layer device design guide, intel corporation. ? system management bus bios interface specification, revision 1.0. intel corporation. ? the i 2 c bus and how to use it, 1995. phillips semiconductors. this document provides electrical and timing specifications for the i 2 c busses. ?i 2 c specification v2.1, phillips semiconductors ? intelligent platform management bus (ipmb) communications protocol specification, version 1.5, 2001, dell computer corporation, hewlett-packard company, intel corporation, and nec corporation. this document provides the transport protocol, electrical specifications, and specific command specifications for the ipmb. 1.4 models and symbols ibis, bsdl, and hspice modeling files are available from your local intel representative. 1.5 physical layer conformance testing physical layer conformance testing (also known as ieee testing) is a fundamental capability for all companies with ethernet lan products. if your company does not have the resources and equipment to perform these tests, consider contracting the tests to an outside facility. once you integrate an external phy with the 82598, the electrical performance of the solution should be characterized for conformance. 1.6 design and board layout checklists layout and schematic checklists are available from your local intel representative. 1.7 number conventions unless otherwise specified, numbers are represented as follows: ? hexadecimal numbers are identified by an ?h? suffix on the number (2ah, 12h) or an ?0x? prefix. ? binary numbers are identified by a ?b? suffix on the number (0011b). values for smbus transactions in diagrams are listed in binary without the ?b? or in hexadecimal without the ?h? ? any other numbers without a suffix are intended as decimal numbers. 1.8 system configurations the 82598 is designed for systems configured as rack-mounted or pedestal servers where it can be used as an add-on network interface card (nic) or lan on motherboard (lom). another system configuration is blade servers, where it can be used as a lom or on a mezzanine card (see figure 1-1 and figure 1-2 ).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 36 october 2010 figure 1-1. typical nic system configuration figure 1-2. typical blade system configuration 1.9 external interfaces figure 1-3 shows the supported 82598 external interfaces.

!" # $ % &'#()*"
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 37 figure 1-3. intel ? 82598 10 gbe controller block diagram 1.9.1 pcie interface the pcie v2.0 (2.5 gt/s) interface is used by the 82598 as a host interface. it supports x8, x4, x2 and x1 configurations at a speed of 2.5 ghz. the maximum aggregated raw bandwidth for typical an x8 configuration is 16 gb/s in each direction. refer to other sections in this document for a full pin description and interface timing characteristics. 1.9.2 xaui interfaces two independent xaui interfaces are used to connect two ports to external devices. they can be configured as an xaui interface that connects directly to another xaui compliant device, as a 10gbase-kx4 interface that connects over a backplane to another kx4 compliant device, or a 10gbase-cx4 interface that attaches to a cx4 compliant cable. the 82598 supports ieee 802.3ae (10 gb/s) implementations. it performs all of the functions required for transmission and reception handling called out in the standards for an xaui media interface. it also supports ieee 802.3ak, ieee 802.3ap (kx and kx4 only), and picmg3.1 (bx only) implementations including an auto-negotiation layer and pcs layer synchronization. the interface can be configured to operate in 1 gb/s mode of operation (bx and kx). one of the 4 xaui lanes (lane 0) is used in 1 gb/s mode.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 38 october 2010 figure 1-4. network interface connections refer to section 2. for full-pin descriptions and section 7 for the timing characteristics of those interfaces. 1.9.3 eeprom interface the 82598 uses an eeprom device for storing product configuration information. several words of the eeprom are accessed by the 82598 after reset in order to provide pre-boot configuration data that must be available to it before it is accessed by host software. the remainder of stored information is accessed by various software modules used to report product configuration, serial number, etc. the 82598 uses a spi (4-wire) serial eeprom device such as a at25040an or compatible. refer to section 2. for full-pin descriptions and section 7 for the timing characteristics of those interfaces.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 39 1.9.4 serial flash interface the 82598 provides an external spi serial interface to a flash (or boot rom) device such as the atmel at25f1024 or at25fb512. the 82598 supports serial flash devices with up to 64 mb (8 mb) of memory. the size of the flash used by the 82598 can be configured by the eeprom. note: though the 82598 supports devices with up to 8 mb of memory, larger devices can be used. access to memory beyond the flash device size results in access wrapping as only lower address bits are used by the flash control unit. 1.9.5 smbus interface smbus is an optional interface for pass-through and/or configuration traffic between an external bmc and the 82598. 1.9.6 nc-si interface nc-si is an optional interface for pass-through and/or configuration traffic between a bmc and the 82598. the following nc-si capabilities are not supported: ? collision detection ? the interface supports only full-duplex operation. ? mdio ? mdio/mdc management traffic is not passed by nc-si. ? magic packets ? magic packets are not detected by the 82598 nc-si receive end. ? the 82598 is not 5 v dc tolerant and requires that signals conform to 3.3 v dc signaling. the nc-si interface provides a connection to an external bmc and operates in one of the following two modes: ? nc-si-smbus mode ? in this mode, the nc-si interface is functional in conjunction with an smbus interface, where pass-through traffic passes through nc-si while configuration traffic passes through smbus. ? nc-si mode ? in this mode, the nc-si interface is functional as a single interface with an external bmc, where all traffic between the 82598 and the bmc flows through this interface. 1.9.7 mdio interfaces the 82598 implements two mii management interfaces (also known as the management data input/ output or mdio interface) for a control plane connection between the xaui mac and phy devices (master side). this interface provides the mac and software the ability to monitor and control the state of the phy. the 82598 supports both 802.3 and 802.3ae data formats for 1 gb/s and 10 gb/s operation. the electricals for the mdio interface are according to 802.3. those interfaces can be controlled by software via mdi single command and address ? msca (0x0425c; rw). each mdio interface should be connected to the relevant phy as shown in the following example (each mdio interface is driven by the appropriate mac function).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 40 october 2010 figure 1-5. mdio connection example the 82598 mdio interface is compliant with 802.3 clause 45 (backward compatible to clause 22). however, pin electricals are 3.3 v dc and not 1.2 v dc as defined by clause 45. 1.9.8 software-definable pins (sdp) interface (general-purpose i/o) the 82598 has eight sdp pins per port; these can be used for miscellaneous hardware or software- controllable purposes. pins can each be individually configurable to act as either input or output pins. the default direction of the lower sdp pins (sdp0[3:0]-sdp1[3:0]) are configurable by eeprom, as well as the default value of these pins if configured as outputs. to avoid signal contention, all pins are set as input pins until the eeprom configuration is loaded. the 82598 also has four of the sdp pins per port; these can be configured for use as general-purpose interrupt (gpi) inputs. to act as gpi pins, the pins must be configured as inputs. a corresponding gpi interrupt-detection enable bit is then used to enable rising-edge detection of the input pin (rising-edge detection occurs by comparing values sampled at the internal clock rate, as opposed to an edge- detection circuit). when detected, a corresponding gpi interrupt is indicated in the interrupt cause register. the use, direction, and values of sdp pins are controlled and accessed using fields in the extended sdp control (esdp) register and extended od sdp control (eodsdp) register. 1.9.9 led interface the 82598 provides four leds per port that can be used to indicate the status of the traffic. the following parameters can be defined for each of the leds: 1. mode: defines which information is reflected by this led. the encoding is described in the ledctl register. 2. polarity: defines the polarity of the led. 3. blink mode: should the led blink or be stable. in addition, the blink rate of all leds can be defined. the possible rates are 200 ms or 83 ms for each phase. there is one rate for all leds. note: see section 3.5.7 for a more detailed description of led behavior.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 41 2. signal descriptions and pinout list signal names are subject to change without notice. verify with your local intel sales office that you have the latest information before finalizing a design. 2.1 signal type definitions signals are electrically defined in table 2-1 . table 2-1. signal definitions name definition i input standard input only digital signal. out (o) output totem pole output (tpo) is a standard active driver. t/s tri-state bi-directional three-state digital input/output pin. o/d open drain enables multiple devices to share as a wire-or. a-in analog input signals. a-out analog output signals. a-inout bi-directional analog signals. b input bias. ncsi-in nc-si input signal. ncsi-out nc-si output signal. pu internal pull-up pd internal pull-down
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 42 october 2010 table 2-2. reserved and no-connect definitions 2.2 pcie interface table 2-3. pcie signal and pin information name definition no connect (nc) these package balls are not connected. reserved no connect (rsvd_nc) these package balls are connected, but are reserved for internal use. they should be left floating on the board-level design. reserved 1p2 (rsvd_1p2) these package balls are connected, but are reserved for internal use. they should be connected to 1.2 v_lan on the board-level design. reserved vss (rsvd_vss) these package balls are connected, but are reserved for internal use. they should be connected to gnd on the board-level design. signal pin number type name and function pe_clkp pe_clkn aj28 ak28 a-in pcie differential reference clock in. a 100 mhz differential clock input. this clock is used as the reference clock for the pcie tx/rx circuitry and by the pcie core pll to generate clocks for the pcie core logic. pet_0_p pet_0_n ah29 ah30 a-out pcie serial data output. a serial differential output pair running at 2.5 gb/s. this output carries both data and an embedded 2.5 ghz clock that is recovered along with data at the receiving end. pet_1_p pet_1_n ae29 ae30 a-out pcie serial data output. a serial differential output pair running at 2.5 gb/s. this output carries both data and an embedded 2.5 ghz clock that is recovered along with data at the receiving end. pet_2_p pet_2_n ab29 ab30 a-out pcie serial data output. a serial differential output pair running at 2.5 gb/s. this output carries both data and an embedded 2.5 ghz clock that is recovered along with data at the receiving end. pet_3_p pet_3_n w29 w30 a-out pcie serial data output. a serial differential output pair running at 2.5 gb/s. this output carries both data and an embedded 2.5 ghz clock that is recovered along with data at the receiving end. pet_4_p pet_4_n n29 n30 a-out pcie serial data output. a serial differential output pair running at 2.5 gb/s. this output carries both data and an embedded 2.5 ghz clock that is recovered along with data at the receiving end. pet_5_p pet_5_n k29 k30 a-out pcie serial data output. a serial differential output pair running at 2.5 gb/s. this output carries both data and an embedded 2.5 ghz clock that is recovered along with data at the receiving end. pet_6_p pet_6_n g29 g30 a-out pcie serial data output. a serial differential output pair running at 2.5 gb/s. this output carries both data and an embedded 2.5 ghz clock that is recovered along with data at the receiving end. pet_7_p pet_7_n d29 d30 a-out pcie serial data output. a serial differential output pair running at 2.5 gb/s. this output carries both data and an embedded 2.5 ghz clock that is recovered along with data at the receiving end.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 43 2.3 xaui interface signals table 2-4. signal and pin information signal pin number type name and function per_0_p per_0_n ag29 ag30 a-in pcie serial data input. a serial differential input pair running at 2.5 gb/s. an embedded clock present in this input is recovered along with the data. per_1_p per_1_n ad29 ad30 a-in pcie serial data input. a serial differential input pair running at 2.5gb/s. an embedded clock present in this input is recovered along with the data. per_2_p per_2_n aa29 aa30 a-in pcie serial data input. a serial differential input pair running at 2.5gb/s. an embedded clock present in this input is recovered along with the data. per_3_p per_3_n v29 v30 a-in pcie serial data input. a serial differential input pair running at 2.5gb/s. an embedded clock present in this input is recovered along with the data. per_4_p per_4_n m29 m30 a-in pcie serial data input. a serial differential input pair running at 2.5gb/s. an embedded clock present in this input is recovered along with the data. per_5_p per_5_n j29 j30 a-in pcie serial data input. a serial differential input pair running at 2.5gb/s. an embedded clock present in this input is recovered along with the data. per_6_p per_6_n f29 f30 a-in pcie serial data input. a serial differential input pair running at 2.5gb/s. an embedded clock present in this input is recovered along with the data. per_7_p per_7_n c29 c30 a-in pcie serial data input. a serial differential input pair running at 2.5gb/s. an embedded clock present in this input is recovered along with the data. pe_rcomp_n pe_rcomp_p r29 r28 b impedance compensation. should be connected with an external 1.4 k ? 1%, 100 ppm resistor. pe_rst_n ak27 i power and clock good indication. indicates that power and the pcie reference clock are within specified values. defined in the pcie specifications. pe_wake_n ag28 o/d wake. pulled to 0b to indicate that a power management event (pme) is pending and the pcie link should be restored. defined in the pcie specifications. signal pin number type name and function rbias rsense ag2 af1 b ? rbias resistor. a 6.5 k ? resistor must be connected between rbias and gnd for proper operation. this resistor generates internal bias currents. ? rsense is an internal sense point and must be connected to the ground connection of the 6.5 k ? rbias resistor, as close to the package as possible. refclkin_p refclkin_n ak3 aj3 a-in external reference clock input. must be connected to a 156.25 mhz +/-0.005% (+/- 50 ppm) clock source. if an external clock is to be applied, it must be 156.25 mhz +/-0.005% (+/- 50 ppm). adequate board layout is required to avoid clock waveform reflections and glitches.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 44 october 2010 signal pin number type name and function rx0_l3_p rx0_l3_n aj23 ak23 a-in xaui serial data input for port 0. a serial differential input pair running at up to 3.125 gb/s. an embedded clock present in this input is recovered along with the data. rx0_l2_p rx0_l2_n aj24 ak24 a-in xaui serial data input for port 0. a serial differential input pair running at up to 3.125 gb/s. an embedded clock present in this input is recovered along with the data. rx0_l1_p rx0_l1_n aj25 ak25 a-in xaui serial data input for port 0. a serial differential input pair running at up to 3.125 gb/s. an embedded clock present in this input is recovered along with the data. rx0_l0_p rx0_l0_n aj26 ak26 a-in xaui serial data input for port 0. a serial differential input pair running at up to 3.125 gb/s. an embedded clock present in this input is recovered along with the data. tx0_l3_p tx0_l3_n aj18 ak18 a-out xaui serial data output for port 0. a serial differential output pair running at up to 3.125 gb/s. this output carries both data and an embedded clock that is recovered along with data at the receiving end. tx0_l2_p tx0_l2_n aj19 ak19 a-out xaui serial data output for port 0. a serial differential output pair running at up to 3.125 gb/s. this output carries both data and an embedded clock that is recovered along with data at the receiving end. tx0_l1_p tx0_l1_n aj20 ak20 a-out xaui serial data output for port 0. a serial differential output pair running at up to 3.125 gb/s. this output carries both data and an embedded clock that is recovered along with data at the receiving end. tx0_l0_p tx0_l0_n aj21 ak21 a-out xaui serial data output for port 0. a serial differential output pair running at up to 3.125 gb/s. this output carries both data and an embedded clock that is recovered along with data at the receiving end. rx1_l3_p rx1_l3_n aj10 ak10 a-in xaui serial data input for port 1. a serial differential input pair running at up to 3.125 gb/s. an embedded clock present in this input is recovered along with the data. rx1_l2_p rx1_l2_n aj11 ak11 a-in xaui serial data input for port 1. a serial differential input pair running at up to 3.125 gb/s. an embedded clock present in this input is recovered along with the data. rx1_l1_p rx1_l1_n aj12 ak12 a-in xaui serial data input for port 1. a serial differential input pair running at up to 3.125 gb/s. an embedded clock present in this input is recovered along with the data. rx1_l0_p rx1_l0_n aj13 ak13 a-in xaui serial data input for port 1. a serial differential input pair running at up to 3.125 gb/s. an embedded clock present in this input is recovered along with the data. tx1_l3_p tx1_l3_n aj5 ak5 a-out xaui serial data output for port 1. a serial differential output pair running at up to 3.125 gb/s. this output carries both data and an embedded clock that is recovered along with data at the receiving end. tx1_l2_p tx1_l2_n aj6 ak6 a-out xaui serial data output for port 1. a serial differential output pair running at up to 3.125 gb/s. this output carries both data and an embedded clock that is recovered along with data at the receiving end. tx1_l1_p tx1_l1_n aj7 ak7 a-out xaui serial data output for port 1. a serial differential output pair running at up to 3.125 gb/s. this output carries both data and an embedded clock that is recovered along with data at the receiving end. tx1_l0_p tx1_l0_n aj8 ak8 a-out xaui serial data output for port 1. a serial differential output pair running at up to 3.125 gb/s. this output carries both data and an embedded clock that is recovered along with data at the receiving end.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 45 2.4 eeprom and serial flash interface signals table 2-5. eeprom signals table 2-6. serial flash signals 2.5 smbus and nc-si signals table 2-7. smbus signals note: if the smbus is disconnected, an external pull-up should be used for smbclk and smbd pins. for suggested pull-up resistor values, refer to section 2.13 . table 2-8. nc-si signals signal pin number type name and function ee_di a5 t/s data output to eeprom. ee_do b6 in data input from eeprom. ee_sk a6 t/s eeprom serial clock that operates at a maximum of 2 mhz. ee_cs_n b7 t/s eeprom chip select output. signal pin number type name and function flsh_si a8 t/s serial data output to the flash. flsh_so a7 in serial data input from the flash. flsh_sck b9 t/s flash serial clock that operates at a maximum of 20 mhz. flsh_ce_n b8 t/s flash chip select output. signal pin number type name and function smbclk aj27 o/d smbus clock. one clock pulse is generated for each data bit transferred. smbd ah28 o/d smbus data. stable during the high period of the clock (unless it is a start or stop condition). smbalrt_n ae3 o/d smbus alert. acts as an interrupt pin of a slave device on the smbus. symbol pin number type name and function ncsi_clk_in b20 ncsi-in nc-si reference clock input. synchronous clock reference for receive, transmit, and control interface. it is a 50 mhz clock/- 50 ppm.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 46 october 2010 note: if nc-si is disconnected, an external pull-up resistor should be connected to the ncsi_txd[1:0] and an external pull down resistor should be connected to the ncsi_clk_in and ncsi_tx_en pins. for suggested pull-up/pull-down values, refer to section 2.13 . for more information on management interfaces, refer section 5. . 2.6 mdi/o signals table 2-9. mdi/o 2.7 software-definable pins table 2-10. software-defined pins ncsi_crs_dv a19 ncsi-out crs/dv. carrier sense/receive data valid. ncsi_rxd_0 ncsi_rxd_1 b18 b19 ncsi-out receive data. data signals to the bmc. ncsi_tx_en a17 ncsi-in transmit enable. ncsi_txd_0 ncsi_txd_1 a20 a18 ncsi-in transmit data. data signals from the bmc. symbol pin number type name and function mdio0 ae2 o/d mgmt data. bi-directional signal for serial data transfers between the 82598 and the phy management registers for port 0. note: requires an external pull-up device. mdc0 ad1 o mgmt clock. clock output for accessing the phy management registers for port 0. nominal frequency can be set to 2.4 mhz (default) or 24 mhz. mdio1 ad2 o/d mgmt data. bi-directional signal for serial data transfers between the 82598 and the phy management registers for port 1. note: requires an external pull-up device. mdc1 ae1 o mgmt clock. clock output for accessing the phy management registers for port 1. nominal frequency can be set to 2.4 mhz (default) or 24 mhz. symbol pin number type name and function sdp0_0 sdp0_1 sdp0_2 sdp0_3 sdp0_4 sdp0_5 w2 v2 v3 u2 u3 t2 t/s general purpose software-defined pins for function 0. sdp0_6 sdp0_7 t3 r2 o/d general purpose o/d software-defined pins for function 0.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 47 2.8 led signals table 2-11. led signals 2.9 miscellaneous signals table 2-12. miscellaneous signals sdp1_0 sdp1_1 sdp1_2 sdp1_3 sdp1_4 sdp1_5 r3 p2 p3 n2 m1 m2 t/s general purpose software-defined pins for function 1. sdp1_6 sdp1_7 l1 l2 o/d general purpose o/d software-defined pins for function 1. symbol pin number type name and function led0_0 ac1 o port 0 led0. by default, programmable led that indicates link-up. led0_1 ac2 o port 0 led1. programmable led that indicates 10 gb/s link. led0_2 ab2 o port 0 led2. by default, programmable led that indicates a link/activity indication. led0_3 aa1 o port 0 led3. by default, programmable led that indicates a 1 gb/s link. led1_0 aa2 o port 1 led0. by default, programmable led that indicates link-up. led1_1 y1 o port 1 led1. by default, programmable led that indicates 10 gb/s link. led1_2 y2 o port 1 led2. by default, programmable led that indicates a link/activity indication. led1_3 w1 o port 1 led3. by default, programmable led that indicates a 1 gb/s link. symbol pin number type name and function lan1_dis_n a11 t/s this pin is a strapping pin latched at the rising edge of lan_pwr_good, internal power on reset, pe_rst_n, or in-band pcie reset. if this pin is not connected or driven high during initialization, lan 1 is enabled. if this pin is driven low during initialization, lan 1 port is disabled. phy0_pwrdn_n b15 o this pin controls the ability to put external phy 0 in power down mode according to the 82598?s internal power state. phy1_pwrdn_n a12 o this pin controls the ability to put external phy 1 in power down mode according to the 82598?s internal power state.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 48 october 2010 2.10 test interface signals table 2-13. test interface signals 2.11 power supplies table 2-14. digital and analog supplies por_bypass ac3 in bypass indication as to whether or not to use internal power on reset or the lan_pwr_good pin. when high, the 82598 disables the internal power on reset circuit and uses the lan_pwr_good pin as the power on reset indication. main_pwr_ok b12 in main power ok . indicates that platform main power is up. must be connected externally. dev_pwrdn_n b13 o this pin can control the external power supply to the 82598 according to the internal power state using an external circuitry. lan0_dis_n b14 t/s this pin is a strapping pin latched at the rising edge of lan_pwr_good, internal power on reset, pe_rst_n, or in-band pcie reset. if this pin is not connected or driven high during initialization, lan 0 is enabled. if this pin is driven low during initialization, lan 0 port is disabled. aux_pwr b16 t/s auxiliary power available. when set, indicates that auxiliary power is available and the 82598 should support d3 cold power state if enabled to do so. this pin is latched at the rising edge of internal power on reset or lan_pwr_good. lan_pwr_good b17 in lan_pwr_good. a transition from low to high initializes the 82598 by resetting it. this pin is used in conjunction with por_bypass. for the pin to operate correctly, the lan_pwr_good circuit needs to be bypassed (por_bypass = 1b). symbol pin number type name and function jtck f2 in jtag clock input. jtdi d2 in jtag data input. jtdo f1 o/d jtag data output. jtms e2 in jtag tms input. jrst_n c2 in jtag reset input. active low reset for the jtag port. symbol pin number type name and function vcc3p3 ab1, v1, n1, h1, c1. 3.3 v dc 3.3 v dc power input.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 49 vcc1p2 y20, y19, y13, y12, y9, y8, y7, y6, v20, v19, v18, v17, v16, v15, v14, v13, v12, v10, v9, v8, v7, v6, t20, t19, t18, t16, t15, t14, t13, t12, t11, t10, t9, t8, t7, t6, p20, p19, p18, p17, p16, p15, p14, p13, p12, p11, p10, p9, p8, p7, p6, m20, m19, m18, m17, m16, m15, m14, m13, m12, m11, m10, m9, m8, m7, m6, k20, k19, k18, k17, k16, k15, k14, k13, k12, k10, k9, k8, k7, k6, h20, h19, h18, h17, h16, h15, h14, h13, h12, h11, h10, h9, h8, h7, h6, f19, f18, f17, f16, f15, f14, f13, f12, f11, f10, f9, f8, f7, f6, d19, d18, d17, d16, d15, d14, d13, d12, d11, d10, d9, d8, d7, d6. 1.2 v dc 1.2 v dc power input. vss ae5, ae4, ad6, ad5, ad4, ac8, ac7, ac6, ac5, ac4, ab11, ab10, ab9, ab8, ab7, ab6, ab5, ab4, aa12, aa11, aa10, aa9, aa8, aa7, aa6, aa5, aa4, y5, y4, w20, w19, w18, w17, w16, w15, w14, w13, w12, w10, w9, w8, w7, w6, w5, w4, v5, u20, u19, u18, u17, u16, u15, u14, u13, u12, u11, u10, u9, u8, u7, u6, u5, t5, r20, r19, r18, r16, r15, r14, r13, r12, r11, r10, r9, r8, r7, r6, r5, p5, n20, n19, n18, n17, n16, n15, n14, n13. n12, n11, n10, n9, n8, n7, n6, n5, m5, l20, l19, l18, l17, l16, l15, l14, l13, l12, l10, l9, l8, l7, l6, l5, k5, j18, j17, j16, j15, j14, j13, j12, j11, j10, j9, j8, j7, j6, j5, h5, g20, g19, g18, g17, g16, g15, g14, g13, g12, g11, g10, g9, g8, g7, g6, g5, f5, e20, e19, e18, e17, e16, e15, e14, e13, e12, e11, e10, e9, e8, e7, e6, e5, d5, c20, c19, c18, c17, c16, c15, c14, c13, c12, c11, c10, c9, c8, c7, c6, c5, b2, b1, a2. 0 v dc core ground (core and pe- vss). vcc1p2 aj16, aj15, ah16, ah15, ag24, ag23, ag22, ag21, ag20, ag19, ag18, ag17, ag16, ag15, ag14, ag13, ag12, ag11, ag10, ag9, ag8, ag7, ag6, af16, af15, ae22, ae21, ae20, ae19, ae18, ae17, ae16, ae15, ae14, ae13, ae12, ae11, ae10, ae9, ad16, ad15, ac20, ac19, ac18, ac17, ac16, ac15, aa19, aa18, aa17, aa16, aa15, y18, y17, y16, y15. 1.2 v dc xaui 1.2 v dc analog power supply. vcc1p2 ah2, ah1, ag5, ag4, ag3, af6, ae8, ae7, ad11, ad10, ad9, ac12, ab13, aa14. 1.2 v dc xaui common 1.2 v dc power supply. vss ak30, ak29, ak22, ak9, ak4, aj30, aj29, aj22, aj17, aj14, aj9, aj4, ah27, ah26, ah25, ah24, ah23, ah22, ah21, ah20, ah19, ah18, ah17, ah14, ah13, ah12, ah11, ah10, ah9, ah8, ah7, ah6, ah5, ag26, ag25, af25, af24, af23, af22, af21, af20, af19, af18, af17, af14, af13, af12, af11, af10, af9, af8, af7, ae24, ae23, ad23, ad22, ad21, ad20, ad19, ad18, ad17, ad14, ad13, ad12, ac22, ac21, ab21, ab20, ab19, ab18, ab17, ab16, ab15, ab14. 0 v dc xaui digital/ analog ground. vss ak2, ak1, aj2, aj1, ah4, ah3, af5, af4, af3, af2, ae6, ad8, ad7, ac11, ac10, ac9, ab12, aa13, y14. 0 v dc xaui common ground. vcc1p2 ad27, ac27, ac25, ab27, ab25, aa27, aa25, aa23, y27, y25, y23, y21, w27, w25, w23, w21, v27, v25, v23, u27, u25, u23, t27, t25, t23, r27, r25, r23, p27, p25, n27, n25, m27, l27. 1.2 v dc 1.2 v dc for pcie* circuits. vcc1p8 v21, u21, t21, r21, p23, p21, n23, n21, m25, m23, m21, l25, l23, l21, k27, k25, k23, k21, j27, j25, j23, j21, h27, h25, h23, h21, g27, g25, g23, g21, f27, f25, f23, f21, e27, e25, e23, e21, d27, d25, d23, d21, c27, c25, c23, c21, b27, b25, b23, b21, a27, a25, a23, a21. 1.8 v dc 1.8 v dc for pcie* circuits. symbol pin number type name and function vss ag27, af30, af29, af28, af27, af26, ae28, ae27, ae26, ad28, ad26, ad25, ac30, ac29, ac28, ac26, ac24, ac23, ab28, ab26, ab24, ab23, ab22, aa28, aa26, aa24, aa22, aa21, aa20, y30, y29, y28, y26, y24, y22, w28, w26, w24, w22, v26, v24, v22, u26, u24, u22, t26, t24, t22, r26, r24, r22, p26, p24, p22, n26, n24, n22, m28, m26, m24, m22, l30, l29, l28, l26, l24, l22, k28, k26, k24, k22, j28, j26, j24, j22, h30, h29, h28, h26, h24, h22, g28, g26, g24, g22, f28, f26, f24, f22, e30, e29, e28, e26, e24, e22, d28, d26, d24, d22, c28, c26, c24, c22, b30, b29, b28, b26, b24, b22, a30, a29, a28, a26, a24, a22. 0 v dc pe ground.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 50 october 2010 2.12 alphabetical pinout/signal name table 2-15 lists the signal name associated with each pin. note: the signal names are subject to change without notice. verify with your local intel sales office that you have the latest information before finalizing a design.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 51 table 2-15. alphabetical pin name/signal name pin name signal name pin name signal name pin name signal name a2 vss b12 main_pwr_ok c22 vss a3 rsvda3_nc b13 dev_pwrdn_n c23 vcc1p8 a4 rsvda4_nc b14 lan0_dis_n c24 vss a5 ee_di b15 phy0_pwrdn_n c25 vcc1p8 a6 ee_sk b16 aux_pwr c26 vss a7 flsh_so b17 lan_pwr_good c27 vcc1p8 a8 flsh_si b18 ncsi_rxd_0 c28 vss a9 rsvda9_nc b19 ncsi_rxd_1 c29 per_7_p a10 rsvda10_nc b20 ncsi_clk_in c30 per_7_n a11 lan1_dis_n b21 vcc1p8 d1 rsvdd1_nc a12 phy1_pwrdn_n b22 vss d2 jtdi a13 (blank) b23 vcc1p8 d3 rsvdd3_nc a14 (blank) b24 vss d4 rsvdd4_nc a15 (blank) b25 vcc1p8 d5 vss a16 (blank) b26 vss d6 vcc1p2 a17 ncsi_tx_en b27 vcc1p8 d7 vcc1p2 a18 ncsi_txd_1 b28 vss d8 vcc1p2 a19 ncsi_crs_dv b29 vss d9 vcc1p2 a20 ncsi_txd_0 b30 vss d10 vcc1p2 a21 vcc1p8 c1 vcc3p3 d11 vcc1p2 a22 vss c2 jrst_n d12 vcc1p2 a23 vcc1p8 c3 rsvdc3_nc d13 vcc1p2 a24 vss c4 rsvdc4_nc d14 vcc1p2 a25 vcc1p8 c5 vss d15 vcc1p2 a26 vss c6 vss d16 vcc1p2 a27 vcc1p8 c7 vss d17 vcc1p2 a28 vss c8 vss d18 vcc1p2 a29 vss c9 vss d19 vcc1p2 a30 vss c10 vss d20 rsvdd20_nc
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 52 october 2010 b1 vss c11 vss d21 vcc1p8 b2 vss c12 vss d22 vss b3 rsvdb3_nc c13 vss d23 vcc1p8 b4 rsvdb4_nc c14 vss d24 vss b5 rsvdb5_nc c15 vss d25 vcc1p8 b6 ee_do c16 vss d26 vss b7 ee_cs_n c17 vss d27 vcc1p8 b8 flsh_ce_n c18 vss d28 vss b9 flsh_sck c19 vss d29 pet_7_p b10 rsvdb10_nc c20 vss d30 pet_7_n b11 rsvdb11_nc c21 vcc1p8 e1 rsvde1_vss e2 jtms f14 vcc1p2 g24 vss e3 rsvde3_nc f15 vcc1p2 g25 vcc1p8 e4 rsvde4_nc f16 vcc1p2 g26 vss e5 vss f17 vcc1p2 g27 vcc1p8 e6 vss f18 vcc1p2 g28 vss e7 vss f19 vcc1p2 g29 pet_6_p e8 vss f20 rsvdf20_nc g30 pet_6_n e9 vss f21 vcc1p8 h1 vcc3p3 e10 vss f22 vss h2 rsvdh2_nc e11 vss f23 vcc1p8 h3 rsvdh3_nc e12 vss f24 vss h4 rsvdh4_nc e13 vss f25 vcc1p8 h5 vss e14 vss f26 vss h6 vcc1p2 e15 vss f27 vcc1p8 h7 vcc1p2 e16 vss f28 vss h8 vcc1p2 e17 vss f29 per_6_p h9 vcc1p2 e18 vss f30 per_6_n h10 vcc1p2 e19 vss g1 rsvdg1_nc h11 vcc1p2 e20 vss g2 rsvdg2_nc h12 vcc1p2 pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 53 e21 vcc1p8 g3 rsvdg3_nc h13 vcc1p2 e22 vss g4 rsvdg4_nc h14 vcc1p2 e23 vcc1p8 g5 vss h15 vcc1p2 e24 vss g6 vss h16 vcc1p2 e25 vcc1p8 g7 vss h17 vcc1p2 e26 vss g8 vss h18 vcc1p2 e27 vcc1p8 g9 vss h19 vcc1p2 e28 vss g10 vss h20 vcc1p2 e29 vss g11 vss h21 vcc1p8 e30 vss g12 vss h22 vss f1 jtdo g13 vss h23 vcc1p8 f2 jtck g14 vss h24 vss f3 rsvdf3_nc f4 rsvdf4_nc g15 vss h25 vcc1p8 f5 vss g16 vss h26 vss f6 vcc1p2 g17 vss h27 vcc1p8 f7 vcc1p2 g18 vss h28 vss f8 vcc1p2 g19 vss h29 vss f9 vcc1p2 g2 rsvdg2_nc h30 vss f10 vcc1p2 g20 vss j1 rsvdj1_vss f11 vcc1p2 g21 vcc1p8 j2 rsvdj2_nc f12 vcc1p2 g22 vss j3 rsvdj3_nc f13 vcc1p2 g23 vcc1p8 j4 rsvdj4_nc j5 vss k16 vcc1p2 l28 vss j6 vss k17 vcc1p2 l29 vss j7 vss k18 vcc1p2 l30 vss j8 vss k19 vcc1p2 m1 sdp1_4 j9 vss k20 vcc1p2 m2 sdp1_5 j10 vss k21 vcc1p8 m3 ncm3 j11 vss k22 vss m4 rsvdm4_nc pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 54 october 2010 j12 vss k23 vcc1p8 m5 vss j13 vss k24 vss m6 vcc1p2 j14 vss k25 vcc1p8 m7 vcc1p2 j15 vss k26 vss m8 vcc1p2 j16 vss k27 vcc1p8 m9 vcc1p2 j17 vss k28 vss m10 vcc1p2 j18 vss k29 pet_5_p m11 vcc1p2 j19 ncj19 k30 pet_5_n m12 vcc1p2 j20 ncj20 l1 sdp1_6 m13 vcc1p2 j21 vcc1p8 l2 sdp1_7 m14 vcc1p2 j22 vss l3 ncl3 m15 vcc1p2 j23 vcc1p8 l4 rsvdl4_nc m16 vcc1p2 j24 vss l5 vss m17 vcc1p2 j25 vcc1p8 l6 vss m18 vcc1p2 j26 vss l7 vss m19 vcc1p2 j27 vcc1p8 l8 vss m20 vcc1p2 j28 vss l9 vss m21 vcc1p8 l10 vss j29 per_5_p l11 ncl11 m22 vss j30 per_5_n l12 vss m23 vcc1p8 k1 nck1 l13 vss m24 vss k2 rsvdk2_nc l14 vss m25 vcc1p8 k3 rsvdk3_nc l15 vss m26 vss k4 rsvdk4_nc l16 vss m27 vcc1p2 k5 vss l17 vss m28 vss k6 vcc1p2 l18 vss m29 per_4_p k7 vcc1p2 l19 vss m30 per_4_n k8 vcc1p2 l20 vss n1 vcc3p3 k9 vcc1p2 l21 vcc1p8 n2 sdp1_3 k10 vcc1p2 l22 vss n3 ncn3 pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 55 k11 nck11 l23 vcc1p8 n4 rsvdn4_nc k12 vcc1p2 l24 vss n5 vss k13 vcc1p2 l25 vcc1p8 n6 vss k14 vcc1p2 l26 vss n7 vss k15 vcc1p2 l27 vcc1p2 n8 vss n9 vss n10 vss p21 vcc1p8 t1 (blank) n11 vss p22 vss t2 sdp0_5 n12 vss p23 vcc1p8 t3 sdp0_6 n13 vss p24 vss t4 nct4 n14 vss p25 vcc1p2 t5 vss n15 vss p26 vss t6 vcc1p2 n16 vss p27 vcc1p2 t7 vcc1p2 n17 vss p28 ncp28 t8 vcc1p2 n18 vss p29 ncp29 t9 vcc1p2 n19 vss p30 (blank) t10 vcc1p2 n20 vss r1 (blank) t11 vcc1p2 n21 vcc1p8 r2 sdp0_7 t12 vcc1p2 n22 vss r3 sdp1_0 t13 vcc1p2 n23 vcc1p8 r4 ncr4 t14 vcc1p2 n24 vss r5 vss t15 vcc1p2 n25 vcc1p2 r6 vss t16 vcc1p2 n26 vss r7 vss t17 nct17 n27 vcc1p2 r8 vss t18 vcc1p2 n28 ncn28 r9 vss t19 vcc1p2 n29 pet_4_p r10 vss t20 vcc1p2 n30 pet_4_n r11 vss t21 vcc1p8 p1 (blank) r12 vss t22 vss p2 sdp1_1 r13 vss t23 vcc1p2 p3 sdp1_2 r14 vss t24 vss pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 56 october 2010 p4 ncp4 r15 vss t25 vcc1p2 p5 vss r16 vss t26 vss p6 vcc1p2 r17 ncr17 t27 vcc1p2 p7 vcc1p2 r18 vss t28 rsvdt28_nc p8 vcc1p2 r19 vss t29 rsvdt29_nc p9 vcc1p2 r2 sdp0_7 t30 (blank) p10 vcc1p2 r20 vss u1 (blank) p11 vcc1p2 r21 vcc1p8 u2 sdp0_3 p12 vcc1p2 r22 vss u3 sdp0_4 p13 vcc1p2 r23 vcc1p2 u4 rsvdu4_nc p14 vcc1p2 r24 vss u5 vss p15 vcc1p2 r25 vcc1p2 u6 vss p16 vcc1p2 r26 vss u7 vss p17 vcc1p2 r27 vcc1p2 u8 vss p18 vcc1p2 r28 pe_rcomp_p u9 vss p19 vcc1p2 r29 pe_rcomp_n u10 vss p20 vcc1p2 r30 (blank) u11 vss u12 vss v23 vcc1p2 y4 vss u13 vss v24 vss y5 vss u14 vss v25 vcc1p2 y6 vcc1p2 u15 vss v26 vss y7 vcc1p2 u16 vss v27 vcc1p2 y8 vcc1p2 u17 vss v28 ncv28 y9 vcc1p2 u18 vss v29 per_3_p y10 rsvdy10_nc u19 vss v30 per_3_n y11 rsvdy11_nc u20 vss w1 led1_3 y12 vcc1p2 u21 vcc1p8 w2 sdp0_0 y13 vcc1p2 u22 vss w3 rsvdw3_nc y14 vss u23 vcc1p2 w4 vss y15 vcc1p2 u24 vss w5 vss y16 vcc1p2 pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 57 u25 vcc1p2 w6 vss y17 vcc1p2 u26 vss w7 vss y18 vcc1p2 u27 vcc1p2 w8 vss y19 vcc1p2 u28 ncu28 w9 vss y20 vcc1p2 u29 ncu29 w10 vss y21 vcc1p2 u30 (blank) w11 ncw11 y22 vss v1 vcc3p3 w12 vss y23 vcc1p2 v2 sdp0_1 w13 vss y24 vss v3 sdp0_2 w14 vss y25 vcc1p2 v4 rsvdv4_nc w15 vss y26 vss v5 vss w16 vss y27 vcc1p2 v6 vcc1p2 w17 vss y28 vss v7 vcc1p2 w18 vss y29 vss v8 vcc1p2 w19 vss y30 vss v9 vcc1p2 w20 vss aa1 led0_3 v10 vcc1p2 w21 vcc1p2 aa2 led1_0 v11 ncv11 w22 vss aa3 rsvdaa3_nc v12 vcc1p2 w23 vcc1p2 aa5 vss v13 vcc1p2 w24 vss aa6 vss v14 vcc1p2 w25 vcc1p2 aa7 vss v15 vcc1p2 w26 vss aa8 vss v16 vcc1p2 w27 vcc1p2 aa9 vss v17 vcc1p2 w28 vss aa10 vss v18 vcc1p2 w29 pet_3_p aa11 vss v19 vcc1p2 w30 pet_3_n aa12 vss v20 vcc1p2 y1 led1_1 aa13 vss v21 vcc1p8 y2 led1_2 aa14 vcc1p2 v22 vss y3 rsvdy3_nc aa15 vcc1p2 aa16 vcc1p2 ab27 vcc1p2 ad8 vss aa17 vcc1p2 ab28 vss ad9 vcc1p2 pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 58 october 2010 aa18 vcc1p2 ab29 pet_2_p ad10 vcc1p2 aa19 vcc1p2 ab30 pet_2_n ad11 vcc1p2 aa20 vss ac1 led0_0 ad12 vss aa21 vss ac2 led0_1 ad13 vss aa22 vss ac3 por_bypass ad14 vss aa23 vcc1p2 ac4 vss ad15 vcc1p2 aa24 vss ac5 vss ad16 vcc1p2 aa25 vcc1p2 ac6 vss ad17 vss aa26 vss ac7 vss ad18 vss aa27 vcc1p2 ac8 vss ad19 vss aa28 vss ac9 vss ad20 vss aa29 per_2_p ac10 vss ad21 vss aa30 per_2_n ac11 vss ad22 vss ab1 vcc3p3 ac12 vcc1p2 ad23 vss ab2 led0_2 ac13 rsvdac13_nc ad24 rsvdad24_nc ab3 rsvdab3_nc ac14 rsvdac14_nc ad25 vss ab4 vss ac15 vcc1p2 ad26 vss ab5 vss ac16 vcc1p2 ad27 vcc1p2 ab6 vss ac17 vcc1p2 ad28 vss ab7 vss ac18 vcc1p2 ad29 per_1_p ab8 vss ac19 vcc1p2 ad30 per_1_n ab9 vss ac20 vcc1p2 ae1 mdc1 ab10 vss ac21 vss ae2 mdio0 ab11 vss ac22 vss ae3 smbalrt_n ab12 vss ac23 vss ae4 vss ab13 vcc1p2 ac24 vss ae5 vss ab14 vss ac25 vcc1p2 ae6 vss ab15 vss ac26 vss ae7 vcc1p2 ab16 vss ac27 vcc1p2 ae8 vcc1p2 ab17 vss ac28 vss ae9 vcc1p2 pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 59 ab18 vss ac29 vss ae10 vcc1p2 ab19 vss ac30 vss ae11 vcc1p2 ab20 vss ad1 mdc0 ae12 vcc1p2 ab21 vss ad2 mdio1 ae13 vcc1p2 ab22 vss ad3 rsvdad3_nc ae14 vcc1p2 ab23 vss ad4 vss ae15 vcc1p2 ab24 vss ad5 vss ae16 vcc1p2 ab25 vcc1p2 ad6 vss ae17 vcc1p2 ab26 vss ad7 vss ae18 vcc1p2 ae19 vcc1p2 af30 vss ah11 vss ae20 vcc1p2 ag1 rsvdag1_nc ah12 vss ae21 vcc1p2 ag2 rbias ah13 vss ae22 vcc1p2 ag3 vcc1p2 ah14 vss ae23 vss ag4 vcc1p2 ah15 vcc1p2 ae24 vss ag5 vcc1p2 ah16 vcc1p2 ae25 rsvdae25_nc ag6 vcc1p2 ah17 vss ae26 vss ag7 vcc1p2 ah18 vss ae27 vss ag8 vcc1p2 ah19 vss ae28 vss ag9 vcc1p2 ah20 vss ae29 pet_1_p ag10 vcc1p2 ah21 vss ae30 pet_1_n ag11 vcc1p2 ah22 vss af1 rsense ag12 vcc1p2 ah23 vss af2 vss ag13 vcc1p2 ah24 vss af3 vss ag14 vcc1p2 ah25 vss af4 vss ag15 vcc1p2 ah26 vss af5 vss ag16 vcc1p2 ah27 vss af6 vcc1p2 ag17 vcc1p2 ah28 smbd af7 vss ag18 vcc1p2 ah29 pet_0_p af8 vss ag19 vcc1p2 ah30 pet_0_n af9 vss ag20 vcc1p2 aj1 vss pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 60 october 2010 af10 vss ag21 vcc1p2 aj2 vss af11 vss ag22 vcc1p2 aj3 refclkin_n af12 vss ag23 vcc1p2 aj4 vss af13 vss ag24 vcc1p2 aj5 tx1_l3_p af14 vss ag25 vss aj6 tx1_l2_p af15 vcc1p2 ag26 vss aj7 tx1_l1_p af16 vcc1p2 ag27 vss aj8 tx1_l0_p af17 vss ag28 pe_wake_n aj9 vss af18 vss ag29 per_0_p aj10 rx1_l3_p af19 vss ag30 per_0_n aj11 rx1_l2_p af20 vss ah1 vcc1p2 aj12 rx1_l1_p af21 vss ah2 vcc1p2 aj13 rx1_l0_p af22 vss ah3 vss aj14 vss af23 vss ah4 vss aj15 vcc1p2 af24 vss ah5 vss aj16 vcc1p2 af25 vss ah6 vss aj17 vss af26 vss ah7 vss aj18 tx0_l3_p af27 vss ah8 vss aj19 tx0_l2_p af28 vss ah9 vss aj20 tx0_l1_p af29 vss ah10 vss aj21 tx0_l0_p aj22 vss ak5 tx1_l3_n ak19 tx0_l2_n aj23 rx0_l3_p ak6 tx1_l2_n ak20 tx0_l1_n aj24 rx0_l2_p ak7 tx1_l1_n ak21 tx0_l0_n aj25 rx0_l1_p ak8 tx1_l0_n ak22 vss aj26 rx0_l0_p ak9 vss ak23 rx0_l3_n aj27 smbclk ak10 rx1_l3_n ak24 rx0_l2_n aj28 pe_clk_p ak11 rx1_l2_n ak25 rx0_l1_n aj29 vss ak12 rx1_l1_n ak26 rx0_l0_n aj30 vss ak13 rx1_l0_n ak27 pe_rst_n ak1 vss ak14 (blank) ak28 pe_clk_n pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 61 2.13 internal/external pull-up/pull-down specifications table 2-16 and table 2-17 list internal/external pull-up/pull-down resistor values and whether or not they are activated in the different device states. for more details about the internal/external pull-up/pull-down requirements, refer to the intel ? 82598 10 gbe controller board layout/schematic checklists (not included in this datasheet) as well as the reference schematics and design guidelines described later in this datasheet. table 2-16. internal and external pull-up and pull-down values the 82598 states are defined as follows: power-up = while 3.3 v dc is stable, but not 1.2 v dc active = normal mode (not power up nor disable) table 2-17. internal/external pull-ups/pull-downs ak2 vss ak15 (blank) ak29 vss ak3 refclkin_p ak17 (blank) ak30 vss ak4 vss ak18 tx0_l3_n aa4 vss min nominal max units pull-up (internal) 2.7 5 8.6 k ? pull-up (external, recommended) 3.3 10 k ? pull-down (external, recommended) 100 470 ? pin name power up active internal pull-up comment internal pull-up comment ee_di y n ee_do y y ee_sk y n ee_cs_n y external pull-up n external pull-up flsh_si y n flsh_so y y flsh_sck y n pin name signal name pin name signal name pin name signal name
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 62 october 2010 flsh_ce_n y external pull-up n external pull-up pin name power up active internal pull-up comment internal pull-up comment smbclk n external pull-up n external pull-up smbd n external pull-up n external pull-up smbalrt_n n external pull-up n external pull-up ncsi_clk_in n n external pull-down in non nc-si ncsi_crs_dv y n external pull-down in non nc-si ncsi_rxd_0 y n external pull-up in non nc-si ncsi_rxd_1 y n external pull-up in non nc-si ncsi_tx_en n hiz n external pull-down in non nc-si ncsi_txd_0 n hiz n external pull-up in non nc-si ncsi_txd_1 n hiz n external pull-up in non nc-si mdio[0] y external pull-up n external pull-up mdc[0] y n mdio[1] y external pull-up n external pull-up mdc[1] y n sdp0[5:0] y y sdp0[7:6] y external pull-up n external pull-up sdp1[5:0] y y sdp1[7:6] y external pull-up n external pull-up led0[3:0] y n led1[3:0] y n lan_pwr_good y y aux_pwr y n external pull-up (if present) external pull-down (not present) lan0_dis_n y y lan1_dis_n y y main_pwr_ok y n jtck y external pull-down n external pull-down jtdi y n external pull-up
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 63 2.14 pin assignments (ball out) this section shows the pin assignments. jtdo y external pull-up n external pull-up pin name power up active internal pull-up comment internal pull-up comment jtms y n external pull-up jrst_n y external pull-down y external pull-down pe_rst_n y n pe_wake_n n external pull-up n external pull-up por_bypass y external pull-up (if bypassed) external pull-down (if not bypassed) n external pull-up (if bypassed) external pull-down (if not bypassed) phy0_pwrdn_n y n phy1_pwrdn_n y n dev_pwrdn_n y n rsvde1_vss y n external pull-down rsvdj1_vss y n external pull-down
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 64 october 2010 figure 2-1. pin map, upper left 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 1 ak vss vss pe_clk_n pe_rst_n rx0_l0_n rx0_l1_n rx0_l2_n rx0_l3_n vssxa tx0_l0_n tx0_l1_n tx0_l2_n tx0_l3_n aj vss vss pe_clk_p smbclk rx0_l0_p rx0_l1_p rx0_l2_p rx0_l3_p vss tx0_l0_p tx0_l1_p tx0_l2_p tx0_l3_p vss vcc1p2 vc c ah pet_0_n pet_0_p smbd vss vss vss vss vss vss vss vss vss vss vss vcc1p2 vc c ag per_0_n per_0_p pe_wake_ n vss vss vss vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vc c af vss vss vss vss vss vss vss vss vss vss vss vss vss vss vcc1p2 vc c ae pet_1_n pet_1_p vss vss vss rsvdae25_ nc vss vss vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vc c ad per_1_n per_1_p vss vcc1p2 vss vsspe rsvdad24_ nc vss vss vss vss vss vss vss vcc1p2 vc c ac vss vss vss vcc1p2 vss vcc1p2 vss vss vss vss vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vc c ab pet_2_n pet_2_p vss vcc1p2 vss vcc1p2 vss vss vss vss vss vss vss vss vss v aa per_2_n per_2_p vss vcc1p2 vss vcc1p2 vss vcc1p2 vss vss vss vcc1p2 vcc1p2 vcc1p2 vcc1p2 vc c y vss vss vss vcc1p2 vss vcc1p2 vss vcc1p2 vss vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vc c w pet_3_n pet_3_p vss vcc1p2 vss vcc1p2 vss vcc1p2 vss vcc1p2 vss vss vss vss vss v v per_3_n per_3_p ncv28 vcc1p2 vss vcc1p2 vss vcc1p2 vss vcc1p8 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vc c u ncu29 ncu28 vcc1p2 vss vcc1p2 vss vcc1p2 vss vcc1p8 vss vss vss vss vss v t rsvdt29_n c rsvdt28_n c vcc1p2 vss vcc1p2 vss vcc1p2 vss vcc1p8 vcc1p2 vcc1p2 vcc1p2 nct17 vcc1p2 vc c
65 figure 2-2. pin assignments, upper right 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 rx1_l0_n rx1_l1_n rx1_l2_n rx1_l3_n vss tx1_l0_n tx1_l1_n tx1_l2_n tx1_l3_n vss refclkin_ p vss vss ak p 2 vcc1p2 vss rx1_l0_p rx1_l1_p rx1_l2_p rx1_l3_p vss tx1_l0_p tx1_l1_p tx1_l2_p tx1_l3_p vss refclkin_ n vss vss aj p 2 vcc1p2 vss vss vss vss vss vss vss vss vss vss vss vss vcc1p2 vcc1p2 ah p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 rbias rsvdag1_ nc ag p 2 vcc1p2 vss vss vss vss vss vss vss vss vcc1p2 vss vss vss vss vssaf1 af p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss vss vss smbalrt_ n mdio0 mdc1 ae p 2 vcc1p2 vss vss vss vcc1p2 vcc1p2 vcc1p2 vss vss vss vss vss rsvdad3_ nc mdio1 mdc0 ad p 2 vcc1p2 rsvdac14_ nc rsvdac13_ nc vcc1p2 vss vss vss vss vss vss vss vss por_bypa ss led0_1 led0_0 ac vss vss vcc1p2 vss vss vss vss vss vss vss vss vss rsvdab3_ nc led0_2 vcc3p3 ab p 2 vcc1p2 vcc1p2 vss vss vss vss vss vss vss vss vss vss rsvdaa3_ nc led1_0 led0_3 aa p 2 vcc1p2 vss vcc1p2 vcc1p2 rsvdy11_1 p2 rsvdy10_1 p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss vss rsvdy3_n c led1_2 led1_1 y vss vss vss vss ncw11 vss vss vss vss vss vss vss rsvdw3_n c sdp0_0 led1_3 w p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 ncv11 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss rsvdv4_n c sdp0_2 sdp0_1 vcc3p3 v vss vss vss vss vss vss vss vss vss vss vss rsvdu4_n c sdp0_4 sdp0_3 u p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss nct4 sdp0_6 sdp0_5 t
66 figure 2-3. pin assignments, lower left cc r pe_rcomp _n pe_rcomp _p vcc1p2 vss vcc1p2 vss vcc1p2 vss vcc1p8 vss vss vss ncr17 vss p ncp29 ncp28 vcc1p2 vss vcc1p2 vss vcc1p8 vss vcc1p8 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 v n pet_4_n pet_4_p ncn28 vcc1p2 vss vcc1p2 vss vcc1p8 vss vcc1p8 vss vss vss vss vss m per_4_n per_4_p vss vcc1p2 vss vcc1p8 vss vcc1p8 vss vcc1p8 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 v l vss vss vss vcc1p2 vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vss vss vss vss k pet_5_n pet_5_p vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 v j per_5_n per_5_p vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 ncj20 ncj19 vss vss vss h vss vss vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 v g pet_6_n pet_6_p vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vss vss vss vss f per_6_n per_6_p vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 rsvdf20_n c vcc1p2 vcc1p2 vcc1p2 vcc1p2 v e vss vss vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vss vss vss vss d pet_7_n pet_7_p vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 rsvdd20_n c vcc1p2 vcc1p2 vcc1p2 vcc1p2 v c per_7_n per_7_p vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vss vss vss vss b vss vss vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 ncsi_clk_i n ncsi_rxd_ 1 ncsi_rxd_ 0 lan_pwr_ good aux_pwr p h a vss vss vss vcc1p8 vss vcc1p8 vss vcc1p8 vss vcc1p8 ncsi_txd_ 0 ncsi_crs_ dv ncsi_txd_ 1 ncsi_tx_e n 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 67 figure 2-4. pin assignments, lower right vss vss vss vss vss vss vss vss vss vss vss ncr4 sdp1_0 sdp0_7 r p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss ncp4 sdp1_2 sdp1_1 p vss vss vss vss vss vss vss vss vss vss vss rsvdn4_n c ncn3 sdp1_3 vcc3p3 n p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss rsvdm4_n c ncm3 sdp1_5 sdp1_4 m vss vss vss vss ncl11 vss vss vss vss vss vss rsvdl4_nc ncl3 sdp1_7 sdp1_6 l p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 nck11 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss rsvdk4_n c rsvdk3_n c rsvdk2_n c nck1 k vss vss vss vss vss vss vss vss vss vss vss rsvdj4_nc rsvdj3_nc rsvdj2_nc rsvdj1_vs s j p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss rsvdh4_n c rsvdh3_n c rsvdh2_n c vcc3p3 h vss vss vss vss vss vss vss vss vss vss vss rsvdg4_n c rsvdg3_n c rsvdg2_n c rsvdg1_n c g p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss rsvdf4_n c rsvdf3_n c jtck jtdo f vss vss vss vss vss vss vss vss vss vss vss rsvde4_n c rsvde3_n c jtms rsvde1_vs s e p 2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vcc1p2 vss rsvdd4_n c rsvdd3_n c jtdi rsvdd1_n c d vss vss vss vss vss vss vss vss vss vss vss rsvdc4_n c rsvdc3_n c jrst_n vcc3p3 c w r phy0_pwr dn_n lan0_dis_ n dev_pwrd n_n main_pwr _ok rsvdb11_n c rsvdb10_n c flsh_sck flsh_ce_n ee_cs_n ee_do rsvdb5_n c rsvdb4_n c rsvdb3_n c vss vss b phy1_pwr dn_n lan1_dis_ n rsvda10_n c rsvda9_n c flsh_si flsh_so ee_sk ee_di rsvda4_n c rsvda3_n c vss a 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 68 october 2010 note: this page intentionally left blank.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 69 3. functional description 3.1 interconnects 3.1.1 pcie pcie defines a set of requirements that address the majority of the targeted application classes. higher-end application requirements (enterprise class servers and high-end communication platforms) are addressed by advanced extensions. to guarantee headroom for future applications of pcie, a software-managed mechanism for introducing capabilities is provided. figure 3-1 shows the architecture. figure 3-1. pcie stack structure the pcie physical layer consists of a differential transmit pair and a differential receive pair. full-duplex data on these two point-to-point connections is self-clocked such that no dedicated clock signals are required. the bandwidth increases in direct proportion with frequency. the packet is the fundamental unit of information exchange and the protocol includes message space to replace the large amounts of side-band signals found on many buses. this movement of hard-wired signals from the physical layer to messages within the transaction layer enables linear physical layer width expansion for increased bandwidth.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 70 october 2010 the common base protocol uses split transactions along with several mechanisms to eliminate wait states and to optimize re-ordering transactions to improve system performance. 3.1.1.1 architecture, transaction and link layer properties ? split transaction, packet-based protocol ? common flat address space for load/store access (for example, pci addressing model): ? 32-bit memory address space to enable a compact packet header (must be used to access addresses below 4 gb) ? 64-bit memory address space using an extended packet header ? transaction layer mechanisms: ? pci-x style relaxed ordering ? optimizations for no-snoop transactions ? credit-based flow control ? packet sizes/formats: ? maximum packet size supports 128-byte and 256-byte data payload ? maximum read request size: 256 bytes ? reset/initialization: ? frequency/width/profile negotiation performed by hardware ? data integrity support: ? using crc-32 for transaction layer packets (tlp) ? link layer retry (llr) for recovery following error detection: ? using crc-16 for link layer (ll) messages ? no retry following error detection: ? 8b/10b encoding with running disparity ? software configuration mechanism: ? uses pci configuration and bus enumeration model ? pcie-specific configuration registers mapped via pci extended capability mechanism ? baseline messaging: ? in-band messaging of formerly side-band legacy signals (interrupts, etc.) ? system-level power management supported via messages ? power management: ? full support for pcim ? wake capability from d3cold state ? compliant with acpi, pcim software model ? active state power management ? support for pcie v2.0 (2.5gt/s): ? support for completion time out ? support for additional registers in the pcie capability structure
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 71 3.1.1.1.1 physical interface properties ? point-to-point interconnect: ? full-duplex; no arbitration ? signaling technology: ? low voltage differential (lvd) ? embedded clock signaling using 8b/10b encoding scheme ? serial frequency of operation: pcie v2.0 (2.5gt/s). ? interface width of x8, x4, x2 or x1. ? dft and dfm support for high-volume manufacturing 3.1.1.1.2 advanced extensions pcie defines a set of optional features to enhance platform capabilities for specific modes. the 82598 supports the following optional features: ? extended error reporting ? messaging support to communicate multiple types/severity of errors ? device serial number ? completion timeout 3.1.1.2 general functionality 3.1.1.2.1 native/legacy all 82598 pci functions are native pcie functions. 3.1.1.2.2 locked transactions the 82598 does not support locked requests as a target or a master. 3.1.1.2.3 end-to-end crc (ecrc) this function is not supported by the 82598. 3.1.1.3 host interface pcie device numbers identify logical devices within the physical device (the 82598 is a physical device). the 82598 implements a single logical device with two separate pci functions: lan 0 and lan 1. the device number is captured from each type 0 configuration write transaction. each pcie function interfaces with the pcie unit through one or more clients. a client id identifies the client and is included in the tag field of the pcie packet header. completions always carry the tag value included in the request to enable routing of the completion to the appropriate client.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 72 october 2010 3.1.1.3.1 tag id allocation tag ids are allocated differently for read and write functions. 1. tag id allocation for read accesses. the tag id is used by hardware in order to be able to forward the read data to the required internal client. tag id description 0x0 data request 0x0 0x1 data request 0x1 0x2 data request 0x2 0x3 data request 0x3 0x4 data request 0x4 0x5 data request 0x5 0x6 data request 0x6 0x7 data request 0x7 0x8 data request 0x8 0x9 data request 0x9 0xa data request 0xa 0xb data request 0xb 0xc data request 0xc 0xd data request 0xd 0xe data request 0xe 0xf data request 0xf 0x10 tx descriptor 0 0x11 tx descriptor 1 0x12 tx descriptor 2 0x13 tx descriptor 3 0x14 tx descriptor 4 0x15 tx descriptor 5 0x16 tx descriptor 6 0x17 tx descriptor 7 0x18 rx descriptor 0 0x19 rx descriptor 1 0x1a rx descriptor 2
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 73 2. tag id allocation for write transactions. request tag allocation depends on these system parameters: ? dca supported/not supported in the system ? dca enabled/disabled in the command line ? system type (chipset) ? cpu id the following cases provide usage examples. case 1 ? dca disabled in the system: the following table lists the write requests tags. case 2 ? dca enabled in the system, but disabled for the request ? fast side bus (fsb) platforms ? if dca is disabled for the request, the tags allocation is similar to the case where dca is disabled in the system. ? csi platforms ? all write requests have the tag of 0x00. case 3 ? dca enabled in the system, dca enabled for the request ? fsb platforms: ? tags are according to the lowest bits of the cpu_id field. ? request tag = {cpu id [3:0], 1111b}. ? csi platforms: ? tags are according to the cpu id. ? request tag = cpu id. tag id description 0x1b rx descriptor 3 0x1c:0x1f reserved tag id description 2 write back (wb) descriptor tx /wb head. 4 wb descriptor rx. 6 write data.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 74 october 2010 3.1.1.3.2 completion timeout mechanism in any split transaction protocol, a risk is associated with the failure of a requester to receive an expected completion. to enable requesters to attempt recovery, a completion timeout mechanism is defined. the completion timeout mechanism is activated for each request that requires completions when the request is transmitted. the pcie v2.0 (2.5 gt/s) specification requires that: ? the completion timeout timer should not expire in less than 10 ms. ? the completion timeout timer must expire if a request is not completed within 50 ms. ? however, some platforms experience completion latencies longer than 50 ms (in some cases up to seconds). the 82598 provides a programmable range for the completion timeout, as well as the ability to disable the completion timeout. pcie v2.0 (2.5 gt/s) specification defines that completion timeout is programmed through an extension of the pcie capability structure. the 82598 controls the following aspects of completion timeout: ? disabling or enabling completion timeout ? disabling or enabling resending a request on completion timeout ? a programmable range of timeout values programming the behavior of completion timeout is done differently depending on whether capability structure version 0x1 or capability structure version 0x2 (future extension) is enabled. table 3-1 lists the behavior. table 3-1. completion timeout programming 3.1.1.3.2.1 completion timeout enable ? version = 0x1 ? loaded from the completion timeout disable bit in the eeprom into the completion_timeout_disable bit in the pcie control (gcr) register. the default is completion timeout enabled . ? version = 0x2 ? programmed through the pci configuration. visible through the completion_timeout_disable bit in the pcie control (gcr) register. the default is: completion timeout enabled . 3.1.1.3.2.2 resend request enable ? version = 0x1 ? the completion timeout resend eeprom bit (loaded to the completion_timeout_resend bit in the pcie control (gcr) register enables resending the request (applies when completion timeout is enabled). the default is to resend a request that timed out. ? version = 0x2 ? same as rev. 1.1. capability capability structure version = 0x1 capability structure version = 0x2 completion timeout enabling loaded from the eeprom into a csr bit. controlled through pci configuration. visible through a read-only csr bit. resend request enable loaded from the eeprom into a csr bit. loaded from the eeprom into a read-only csr bit. completion timeout period loaded from the eeprom into a csr bit. controlled through pci configuration. visible through a read-only csr bit.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 75 3.1.1.3.2.3 completion timeout period ? version = 0x1 ? loaded from the completion timeout value field in the eeprom to the completion_timeout_value bits in the pcie control (gcr) register. the following values are supported: ? 50 s to 10 ms (default) ? 10 ms to 250 ms ? 250 ms to 4 s ? 4 s to 64 s ? version = 0x2 ? programmed through the pci configuration. visible through the completion_timeout_value bits in the pcie control (gcr) register. the 82598 supports all four ranges defined by the pcie ecr: ? 50 s to 10 ms ? 10 ms to 250 ms ? 250 ms to 4 s ? 4 s to 64 s system software programs a range (one of nine possible ranges that sub-divide the previously mentioned four ranges) into the pci configuration register. the supported sub-ranges are: ? 50 s to 50 ms (default). ? 50 s to 100 s ? 1 ms to 10 ms ? 16 ms to 55 ms ? 65 ms to 210 ms ? 260 ms to 900 ms ? 1 s to 3.5 s ? s to 13 s ? 17 s to 64s a memory read request for which there are multiple completions is considered complete only when all completions have been received by the requester. if some but not all requested data is returned before the completion timeout timer expires, the requestor is permitted to keep or discard data that was returned prior to expiration. 3.1.1.4 transaction layer the upper layer of the pcie architecture is the transaction layer. the transaction layer connects to the 82598's core using an implementation-specific protocol. through this core-to-transaction-layer protocol, application-specific parts of the 82598 interact with the pcie subsystem and transmits and receives requests to or from a remote pcie agent, respectively.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 76 october 2010 3.1.1.4.1 transaction types accepted table 3-2. transaction types accepted by the transaction layer legend: ? ph ? posted request headers ? pd ? posted request data payload ? nph ? non-posted request headers ? npd ? non-posted request data payload ? cplh ? completion headers ? cpld ? completion data payload 3.1.1.4.1.1 partial memory read and write requests the 82598 has limited support for read and write requests with only part of the byte enable bits set: ? partial writes with at least one byte enabled are executed as full writes. any side effect of a full write (such as clear by write) is also applicable to partial writes. ? zero-length writes have no internal impact (nothing written, no effect such as clear-by-write). the transaction is treated as a successful operation (no error event). ? partial reads with at least one byte enabled must be answered as a full read. any side effect of the full read (such as clear by read) is also applicable to partial reads. ? zero-length reads generate a completion, but the register is not accessed and undefined data is returned. transaction type fc type tx later reaction hardware should keep data from original packet for client configuration read request nph cplh + cpld requester id, tag, attribute configuration space configuration write request nph + npd cplh requester id, tag, attribute configuration space memory read request nph cplh + cpld requester id, tag, attribute csr memory write request ph + pd ? ? csr i/o read request nph cplh + cpld requester id, tag, attribute csr i/o write request nph + npd cplh requester id, tag, attribute csr read completions cplh + cpld ? ? dma message ph ? ? message unit/int/ pm/error unit
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 77 3.1.1.4.2 transaction types initiated table 3-3. transaction types initiated by the transaction layer note: max_payload_size is loaded from the eeprom (either 128 bytes or 256 bytes). effective max_payload_size is defined for each pci function according to the configuration space register for that function. 3.1.1.4.2.1 data alignment requests must never specify an address/length combination that causes a memory space access to cross a 4 kb boundary. the 82598 breaks requests into 4 kb-aligned requests (if needed). this does not pose any requirement on software. however, if software allocates a buffer across a 4 kb boundary, hardware issues multiple requests for the buffer. consider aligning buffers to a 4 kb boundary in cases where this improves performance. the general rules for packet alignment are as follows. note that these apply to all requests (read/write, snoop and no snoop): 1. the length of a single request does not exceed the pcie limit of max_payload_size for write and max_read_req for read. 2. the length of a single request does not exceed 82598 internal limitations. 3. a single request does not span across different memory pages as noted by the 4 kb boundary alignment above. if a request can be sent as a single pcie packet and still meet the general rules for packet alignment, then it is not broken at the cache line boundary but rather sent as a single packet (the chipset might break the request along cache line boundaries, but the 82598 will still benefit from better pcie use). however, if general rules 1-3 require that the request be broken into two or more packets, then the request will be broken at the cache line boundary. transaction type payload size fc type from client configuration read request completion dword cplh + cpld configuration space configuration write request completion ? cplh configuration space i/o read request completion dword cplh + cpld csr i/o write request completion ? cplh csr read request completion dword/qword cplh + cpld csr memory read request ? nph dma memory write request <= max_payload_size ph + pd dma, msi/msi-x message ? - ph message unit/int/pm/ error unit
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 78 october 2010 3.1.1.4.2.2 multiple tx data read requests (mulr) the 82598 supports 16 multiple pipelined requests for transmit data. in general, requests belong to the same packet or to consecutive packets. however, the following restrictions apply: ? all requests for a packet are issued before a request is issued for a consecutive packet. ? read requests can be issued from any of the supported queues, as long as the above restriction is met. pipelined requests can belong to the same queue or to separate queues. however, as noted above, all requests for a certain packet are issued (from the same queue) before a request is issued for a different packet (potentially from a different queue). ? the pcie v2.0 (2.5 gt/s) specification does not insure that completions for separate requests return in-order. read completions for concurrent requests are not required to return in the order issued. the 82598 handles completions that arrive in any order. once all completions arrive for a given request, it can issue the next pending read data request. ? the 82598 incorporates a reorder buffer to support re-ordering of completions for all issued requests. each request/completion can be up to 256 bytes long. the maximum size of a read request is defined as the minimum {256 bytes, max_read_request_size}. ? in addition to the transmit data requests, the 82598 can issue eight pipelined read requests for tx descriptors and four pipelined read requests for rx descriptors. the requests for tx data, tx descriptors, and rx descriptors are independently issued. 3.1.1.5 messages 3.1.1.5.1 received messages message packets are special packets that carry a message code. the upstream device transmits special messages to the 82598 by using this mechanism. the transaction layer decodes the message code and responds to the message accordingly. table 3-4. supported message (as a receiver) 3.1.1.5.2 transmitted messages the transaction layer is also responsible for transmitting specific messages to report internal/external events (such as interrupts and pmes). message code [7:0] routing r2r1r0 message later response 0x14 100b pm_active_state_nak internal signal set 0x19 011b pme_turn_off internal signal set 0x50 100b slot power limit support (has one dword data) silently drop 0x7e 010b, 011b,100b vendor_defined type 0 no data unsupported request 0x7e 010b,011b,100b vendor_defined type 0 data unsupported request 0x7f 010b,011b,100b vendor_defined type 1 no data silently drop 0x7f 010b, 011b,100b vendor_defined type 1 data silently drop 0x00 011b unlock silently drop
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 79 table 3-5. initiated messages 3.1.1.6 ordering rules the 82598 meets the pcie ordering rules (pci-x rules) by following the simple device model: 1. deadlock avoidance ? master and target accesses are independent ? the response to a target access does not depend on the status of a master request to the bus. if master requests are blocked (due to no credits), target completions can still proceed (if credits are available). 2. descriptor/data ordering ? the device does not proceed with some internal actions until respective data writes have ended on the pcie link: 3. the 82598 does not update an internal header pointer until the descriptors that the header pointer relates to are written to the pcie link. 4. the 82598 does not issue a descriptor write until the data that the descriptor relates to is written to the pcie link. 5. the 82598 might issue the following master read request from each of the following clients: a. rx descriptor read (four for each lan port) b. tx descriptor read (eight for each lan port) c. tx data read (up to 16 for each lan port for manageability) note: completion for separate read requests are not guaranteed to return in order. completions for a single read request are guaranteed to return in address order. message code [7:0] routing r2r1r0 message 0x20 100b assert int a 0x21 100b assert int b 0x22 100b assert int c 0x23 100b assert int d 0x24 100b de- assert int a 0x25 100b de- assert int b 0x26 100b de- assert int c 0x27 100b de- assert int d 0x30 000b err_cor 0x31 000b err_nonfatal 0x33 000b err_fatal 0x18 000b pm_pme 0x1b 101b pme_to_ack
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 80 october 2010 3.1.1.6.1 out of order completion handling in a split transaction protocol, using multiple read requests in a multi-processor environment, there is a risk that completions will arrive from the host memory out of order and interleaved. in this case, the 82598 sorts the request completion and transfers them to the ethernet in the correct order. 3.1.1.7 transaction definition and attributes 3.1.1.7.1 max payload size the 82598's policy for determining max payload size (mps) is as follows: 1. master requests initiated by the 82598 (including completions) limit max payload size to the value defined for the function issuing the request. 2. target write accesses to the 82598 are accepted only with a size of one dword or two dwords. write accesses in the range of three dwords (mps) are flagged as unreliable. write accesses above mps are flagged as malformed. 3.1.1.7.2 traffic class (tc) and virtual channels (vc) the 82598 only supports tc = 0 and vc = 0 (default). 3.1.1.7.3 relaxed ordering the 82598 takes advantage of the relaxed ordering rules in pcie. by setting the relaxed ordering bit in the packet header, the 82598 enables the system to optimize performance in the following cases: 1. relaxed ordering for descriptor and data reads ? when the 82598 masters a read transaction, its split completion has no ordering relationship with the writes from the cpus (same direction). it should be allowed to bypass the writes from the cpus. 2. relaxed ordering for receiving data writes ? when the 82598 masters receive data writes, it also enables them to bypass each other in the path to system memory because software does not process this data until their associated descriptor writes are done. 3. the 82598 cannot relax ordering for descriptor writes or an msi write. relaxed ordering can be used in conjunction with the no-snoop attribute to enable the memory controller to advance no-snoop writes ahead of earlier snooped writes. relaxed ordering is enabled in the 82598 by clearing the ro_dis bit in the extended device control (ctrl_ext) register (0x00018; rw). the actual setting of relaxed ordering is done for lan traffic by the host through the dca registers and for headers redirection through an eeprom setting. 3.1.1.7.4 no snoop the 82598 sets the snoop_not_required attribute bit for master data writes. system logic might provide a separate path to system memory for non-coherent traffic. the non-coherent path to system memory provides a higher, more uniform, bandwidth for write requests. note: the snoop not required attribute does not alter transaction ordering. therefore, to achieve the maximum benefit from snoop not required transactions, it is advisable to set the relaxed ordering attribute as well (assuming that system logic supports both attributes). in fact, some chipsets require that relaxed ordering is set for no-snoop to take effect. no snoop is enabled by clearing the ns_dis bit in the extended device control (ctrl_ext) register ? (0x00018; rw). the actual setting of no snoop is done for lan traffic by the host through dca registers and for headers redirection through an eeprom setting.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 81 3.1.1.7.5 no snoop and relaxed ordering for lan traffic software might configure no-snoop and relax order attributes for each queue and each type of transaction by setting the respective bits in the dca_rxctrl and tca_txctrl registers. table 3-6 lists the default behavior for the no-snoop and relaxed ordering bits for lan traffic when i/oat 2 is enabled. table 3-6. lan traffic attributes note: rx payload no-snoop is also conditioned by the nse bit in the receive descriptor. 3.1.1.7.5.1 no snoop option for payload under certain conditions, which occur when i/oat 2 is enabled, software knows that it is safe to transfer a new packet into a certain buffer without snooping on the fsb. this scenario occurs when software is posting a receive buffer to hardware that the cpu has not accessed since the last time it was owned by hardware. this might happen if the data was transferred to an application buffer by the data movement engine. in this case, software should be able to set a bit in the receive descriptor indicating that the 82598 should perform a no-snoop transfer when it eventually writes a packet to this buffer. when a no-snoop transaction is activated, the tlp header has a no-snoop attribute in the transaction descriptor field. this is triggered by the nse bit in the receive descriptor. 3.1.1.8 flow control 3.1.1.8.1 82598 flow control rules the 82598 implements only the default virtual channel (vc0). a single set of credits is maintained for vc0. transaction no snoop default relaxed ordering default comments rx descriptor read n y rx descriptor write-back n n read-only. must never be used for this traffic. rx data write y y see note and the section that follows. rx replicated header n y tx descriptor read n y tx descriptor write-back n y tx data write n y
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 82 october 2010 table 3-7. flow control credits allocation rules for fc updates: ? the 82598 maintains two credits for npd at any given time. it increments the credit by one after a credit is consumed and sends an updatefc packet as soon as possible. updatefc packets are scheduled immediately after a resource is available. ? the 82598 provides two credits for ph (such as, for two concurrent target writes) and two credits for nph (such as, for two concurrent target reads). updatefc packets are scheduled immediately after a resource is available. ? the 82598 follows the pcie recommendations for frequency of updatefc fcps. 3.1.1.8.2 upstream flow control tracking the 82598 issues a master transaction only when the required flow control credits are available. credits are tracked for posted, non-posted, and completions (the later to operate against a switch). 3.1.1.8.3 flow control update frequency in all cases updatefc packets are scheduled immediately after a resource is available. when the link is in the l0 or l0s link state, update fcps for each enabled type of non-infinite flow control credit must be scheduled for transmission at least once every 30 s (-0% /+50%), except when the extended sync bit of the control link register is set, in which case the limit is 120 s (-0% /+50%). 3.1.1.8.4 flow control timeout mechanism the 82598 implements the optional flow control update timeout mechanism. the mechanism is active when the link is in l0 or l0s link state. it uses a timer with a limit of 200 s (- 0% /+50%), where the timer is reset by the receipt of any init or update fcp. alternately, the timer can be reset by the receipt of any dllp. upon timer expiration, the mechanism instructs the phy to retrain the link (using the ltssm recovery state). credit type operations number of credits posted request header (ph) target write (1 unit) message (1 unit) 8 units (to enable concurrent accesses to both lan ports). posted request data (pd) target write (length/16 bytes = 1) message (1 unit) max_payload_size/16. non-posted request header (nph) target read (1 unit) configuration read (1 unit) configuration write (1 unit) 4 units (to enable concurrent target accesses to both lan ports). non-posted request data (npd) configuration write (1 unit) 4 units. completion header (cplh) read completion (n/a) infinite (accepted immediately). completion data (cpld) read completion (n/a) infinite (accepted immediately).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 83 3.1.1.9 error forwarding if a tlp is received with an error-forwarding trailer, the packet is dropped and is not delivered to its destination. the 82598 does not initiate additional master requests for that pci function until it detects an internal software reset for associated lan port. software is able to access device registers after such a fault. system logic is expected to trigger a system-level interrupt to inform the operating system of the problem. operating systems can then stop the process associated with the transaction, re-allocate memory instead of the faulty area, etc. 3.1.1.10 link layer 3.1.1.10.1 ack/nak scheme the 82598 supports two alternative schemes for ack/nak rate: 1. ack/nak is scheduled for transmission following any tlp. 2. ack/nak is scheduled for transmission according to timeouts specified in the pcie v2.0 (2.5 gt/s) specification. the pcie error recovery bit (loaded from the eeprom) determines which of the two schemes is used. 3.1.1.10.2 supported dllps the following dllps are supported by the 82598 as a receiver: 1. ack 2. nak 3. pm_request_ack 4. initfc1-p 5. initfc1-np 6. initfc1-cpl 7. initfc2-p 8. initfc2-np 9. initfc2-cpl 10. updatefc-p 11. updatefc-np 12. updatefc-cpl the following dllps are supported by the 82598 as a transmitter: 1. ack 2. nak 3. pm_enter_l1 4. pm_enter_l23 5. initfc1-p 6. initfc1-np 7. initfc1-cpl 8. initfc2-p 9. initfc2-np
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 84 october 2010 10. initfc2-cpl 11. updatefc-p 12. updatefc-np note: updatefc-cpl is not sent because of the infinite fc-cpl allocation. 3.1.1.10.3 transmit edb nullifying in the event of a retrain necessity, there is a need to guarantee that no abrupt termination of the tx packet happens. for this reason, early termination of the transmitted packet is possible. this is done by appending the edb to the packet. 3.1.1.11 phy 3.1.1.11.1 link speed the 82598 supports pcie v2.0 (2.5 gt/s). the 82598 does not initiate a hardware autonomous speed change and as a result the hardware autonomous speed disable bit in the pcie link control 2 register is hardwired to 0b. the 82598 supports entering compliance mode at the speed indicated in the target link speed field in the pcie link control 2 register. 3.1.1.11.2 link width ? the 82598 supports a maximum link width of x8, x4, x2, or x1 as determined by the eeprom lane_width field. the maximum link width is loaded into the maximum link width field of the pcie capability register (lcap[11:6]). the hardware default is the x8 link. during link configuration, the platform and the 82598 negotiate on a common link width. the link width must be one of the supported pcie link widths (x1, 2x, x4, x8), such that: ? if maximum link width = x8, then the 82598 negotiates to either x8, x4, x2 or x1 1 ? if maximum link width = x4, then the 82598 negotiates to either x4 or x1 ? if maximum link width = x1, then the 82598 only negotiates to x1 the 82598 does not initiate a hardware autonomous link width change and the hardware autonomous width disable bit in the pcie link control register is hardwired to 0b. 3.1.1.11.3 polarity inversion if polarity inversion is detected the receiver must invert the received data. during the training sequence, the receiver looks at symbols 6-15 of ts1 and ts2 as the indicator of lane polarity inversion (d+ and d- are swapped). if lane polarity inversion occurs, the ts1 symbols 6- 15 received are d21.5 as opposed to the expected d10.2. similarly, if lane polarity inversion occurs, symbols 6-15 of the ts2 ordered set are d26.5 as opposed to the expected 5 d5.2. this provides the clear indication of lane polarity inversion. 1. see restriction in section 3.1.1.11.6 .
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 85 3.1.1.11.4 l0s exit latency the number of fts sequences (n_fts) sent during l0s exit is loaded from the eeprom into an 8-bit read-only register. 3.1.1.11.5 lane-to-lane de-skew a multi-lane link can have many sources of lane-to-lane skew. although symbols are transmitted simultaneously on all lanes, they cannot be expected to arrive at the receiver without lane-to-lane skew. the lane-to-lane skew can include components, which are less than a bit time, bit time units (400 ps for 2.5 gb), or full symbol time units (4 ns) of skew caused by the retiming repeaters' insert/delete operations. receivers use ts1 or ts2 or skip ordered sets (sos) to perform link de-skew functions. the 82598 supports de-skew of up to five symbols time (20 ns). 3.1.1.11.6 lane reversal the following lane reversal modes are supported: ? lane configurations x8, x4, x2, and x1 ? lane reversal in x8 and in x4 ? degraded mode (downshift) from x8 to x4 to x2 to x1 and from x4 to x1, with one restriction ? if lane reversal is executed in x8, then downshift is only to x1 and not to x4 figure 3-2 through figure 3-5 shows the lane downshift in both regular and reversal connections as well as lane connectivity from a system level perspective. figure 3-2. lane downshift in an x8 configuration l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 82598 x e i c p l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 82598 x e i c p d o w n g r a d e t o x 4 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 82598 x e i c p d o w n g r a d e t o x 1 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 86 october 2010 figure 3-3. lane downshift in a reversal x8 configuration figure 3-4. lane downshift in a x4 configuration l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 82598 x e i c p l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 82598 x e i c p d o w n g r a d e t o x 1 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 82598 x e i c p l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 82598 x e i c p d o w n g r a d e t o x 1
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 87 figure 3-5. lane downshift in an x4 reversal configuration the lane reversal feature can be controlled by the eeprom lane reversal disable bit. 3.1.1.11.7 reset the pcie phy supplies core reset to the 82598. reset can be caused by the following: 1. upstream move to hot reset ? inband mechanism (ltssm). 2. recovery failure (ltssm returns to detect). 3. upstream component moves to disable. 3.1.1.11.8 scrambler disable the scrambler/de-scrambler functionality in the 82598 can be eliminated by three mechanisms: 1. upstream, according to the pcie v2.0 (2.5 gt/s) specification. 2. eprom bit ? scram_dis. 3. ibist jtag csr. 3.1.1.12 error events and error reporting 3.1.1.12.1 general description pcie defines two error reporting paradigms: the baseline capability and the advanced error reporting (aer) capability. baseline error report capabilities are required of all pcie devices and define the minimum error reporting requirements. the aer capability is defined for more robust error reporting and is implemented with a specific pcie capability structure. both mechanisms are supported by the 82598. also the serr# enable and the parity error bits from the legacy command register take part in the error reporting and logging mechanism. l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 82598 x e i c p l a n e # 0 l a n e # 1 l a n e # 2 l a n e # 3 l a n e # 4 l a n e # 5 l a n e # 6 l a n e # 7 l a n e # 0 82598 x e i c p d o w n g r a d e t o x 1
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 88 october 2010 figure 3-6. error reporting mechanism 3.1.1.12.2 error events table 3-8 lists the error events identified by the 82598 and the response in terms of logging, reporting, and actions taken. refer to the pcie v2.0 (2.5 gt/s) specification for the effect on the pci status register.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 89 table 3-8. response and reporting of pcie error events error name error events default severity action physical layer errors receiver error ? 8b/10b decode errors ? packet framing error correctable send err_corr tlp to initiate nak, drop data dllp to drop data link errors bad tlp ? bad crc ? not legal edb ? wrong sequence number correctable send err_corr tlp to initiate nak, drop data bad dllp ? bad crc correctable send err_corr dllp to drop replay timer timeout ? replay_timer expiration correctable send err_corr follow ll rules replay num rollover ? replay num rollover correctable send err_corr follow ll rules data link layer protocol error ? violations of flow control initialization protocol uncorrectable send err_fatal tlp errors poisoned tlp received ? tlp with error forwarding uncorrectable err_nonfatal log header if poisoned completion, no more requests from this client unsupported request (ur) ? wrong config access ? mrdlk ? config request type1 ? unsupported vendor defined type 0 message ? not valid msg code ? not supported tlp type ? wrong function number ? wrong tc ? received target access with data size >64 bits ? received tlp outside address range uncorrectable err_nonfatal log header send completion with ur completion timeout ? completion timeout timer expired uncorrectable err_nonfatal send the read request again completer abort ? attempts to write to the flash device when writes are disabled (fwe=10b) uncorrectable. err_nonfatal log header send completion with ca unexpected completion ? received completion without a request for it (tag, id, etc.) uncorrectable err_nonfatal log header discard tlp receiver overflow ? received tlp beyond allocated credits uncorrectable err_fatal receiver behavior is undefined
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 90 october 2010 3.1.1.12.3 error pollution error pollution can occur if error conditions for a given transaction are not isolated to the error's first occurrence. if the phy detects and reports a receiver error, to avoid having this error propagate and cause subsequent errors at the upper layers, the same packet is not signaled at the data link or transaction layers. similarly, when the data link layer detects an error, subsequent errors that occur for the same packet are not signaled at the transaction layer. 3.1.1.12.4 completion with unsuccessful completion status a completion with unsuccessful completion status is dropped and not delivered to its destination. the request that corresponds to the unsuccessful completion is retried by sending a new request for the data. 3.1.1.12.5 error reporting changes the pcie v2.0 (2.5 gt/s) specification defines two changes to advanced error reporting. the role- based error reporting bit in the device capabilities register is set to 1b to indicate that these changes are supported: ? setting the serr# enable bit in the pci command register enables ur reporting (in the same manner that the serr# enable bit enables reporting of correctable and uncorrectable errors). in other words, the serr# enable bit overrides the ur error reporting enable bit in the pcie device control register. ? changes in the response to some uncorrectable non-fatal errors detected in non-posted requests to the 82598. these are called advisory non-fatal error cases. for the errors listed, the following is defined: ? the advisory non-fatal error status bit is set in the correctable error status register to indicate the occurrence of the advisory error and the advisory non-fatal error mask corresponding bit in the correctable error mask register is checked to determine whether to proceed further with logging and signaling. error name error events default severity action flow control protocol error ? ? minimum initial flow control advertisements ? flow control update for infinite credit advertisement uncorrectable. err_fatal receiver behavior is undefined malformed tlp (mp) ? data payload exceed max_payload_size ? received tlp data size does not match length field ? td field value does not correspond with the observed size ? byte enables violations ? pm messages that don?t use tc0 ? usage of unsupported vc uncorrectable err_fatal log header drop the packet, free fc credits completion with unsuccessful completion status no action (already done by originator of completion) free fc credits
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 91 ? if the advisory non-fatal error mask bit is clear, logging proceeds by setting the corresponding bit in the uncorrectable error status register, based upon the specific uncorrectable error that's being reported as an advisory error. if the corresponding uncorrectable error bit in the uncorrectable error mask register is clear, the first error pointer and header log registers are updated to log the error, assuming they are not still occupied by a previous unserviced error. ? an err_cor message is sent if the correctable error reporting enable bit is set in the device control register. an error_nonfatal message is not sent for this error. the following uncorrectable non-fatal errors are considered as advisory non-fatal errors: ? a completion with an unsupported request or completer abort (ur/ca) status that signals an uncorrectable error for a non-posted request. if the severity of the ur/ca error is non-fatal, the completer must handle this case as an advisory non-fatal error. ? when the requestor of a non-posted request times out while waiting for the associated completion, the requestor is permitted to attempt to recover from the error by issuing a separate subsequent request or to signal the error without attempting recovery. the requester is permitted to attempt recovery zero, one, or multiple (finite) times; but it must signal the error (if enabled) with an uncorrectable error message if no further recovery attempt is made. if the severity of the completion timeout is non-fatal and the requester elects to attempt recovery by issuing a new request, the requester must first handle the current error case as an advisory non-fatal error. ? when a receiver receives an unexpected completion and the severity of the unexpected completion error is non-fatal, the receiver must handle this case as an advisory non-fatal error. 3.1.1.13 performance monitoring the 82598 incorporates pcie performance monitoring counters to provide common capabilities to evaluate performance. the device implements four 32-bit counters to correlate between concurrent measurements of events as well as the sample delay and interval timers. the four 32-bit counters can also operate in 64-bit mode to count long intervals or payloads. the list of events supported by the 82598 and the counters control bits are described in the pcie register section (see section 4. ). 3.1.1.14 configuration registers 3.1.1.14.1 pci compatibility pcie is compatible with existing deployed pci software. pcie hardware implementations conform to the following requirements: 1. all devices are required to support deployed pci software and must be enumerable as part of a tree through pci device enumeration mechanisms. 2. devices must not require resources (such as address decode ranges and interrupts) beyond those claimed by pci resources for operation of existing deployed pci software. 3. devices in their default operating state must confirm to pci ordering and cache coherency rules from a software viewpoint. 4. pcie devices must conform to the pci power management specification and must not require any register programming for pci-compatible power management beyond those available through pci power management capability registers. power management is expected to conform to a standard pci power management by existing pci bus drivers. pcie devices implement all registers required by the pcie v2.0 (2.5 gt/s) specification as well as the power management registers and capability pointers specified by the pci power management specification. in addition, pcie defines a pcie capability pointer to indicate support for pcie extensions and associated capabilities.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 92 october 2010 the 82598 is a multi-function device with the following functions: ? lan 0 ? lan 1 different parameters affect how lan functions are exposed on pcie. all functions contain the following regions of the pci configuration space: ? mandatory pci configuration registers ? power management capabilities ? msi capabilities ? pcie extended capabilities 3.1.1.14.2 configuration sharing among pci functions the 82598 contains a single physical pcie core interface. it is designed so that each logical lan device (lan 0, lan 1) appears as a distinct function implementing, amongst other registers, pcie device header space as listed in table 3-9 . table 3-9. pcie device header space map byte offset byte 3 byte 2 byte 1 byte 0 0x0 device id vendor id 0x4 status register command register 0x8 class code (0x020000) revision id (0x03) 0xc reserved (0x00) header type (0x00) latency timer cache line size 0x10 base address 0 0x14 base address 1 0x18 base address 2 0x1c base address 3 0x20 base address 4 0x24 base address 5 0x28 cardbus cis pointer (not used) 0x2c subsystem id subsystem vendor id 0x30 expansion rom base address 0x34 reserved cap_ptr 0x38 reserved 0x3c max_latency (0x00) min_grant (0xff) interrupt pin (0x01 or 0x02) interrupt line (0x00)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 93 many of the fields of the pcie header space contain hardware default values that are either fixed or can be overridden using an eeprom, but might not be independently specified for each logical lan device. the fields listed in the table below are common to both lan devices. table 3-10. fields common to lan 0, lan 1 the following fields are implemented uniquely for each lan device. table 3-11. unique fields 3.1.1.14.3 mandatory pci configuration registers the pci configuration registers map is depicted below. refer to the detailed descriptions for registers loaded from the eeprom at initialization. initialization values of the configuration registers are marked in parenthesis. notation: vendor id the vendor id of the 82598 is specified to a single value of 0x8086. the value is reflected identically for both lan devices. revision the revision number of the 82598 is reflected identically for both lan devices. header type this field indicates if a device is single function or multifunction. the value reflected in this field is reflected identically for both lan devices, but the actual value reflected depends on lan disable configuration. when both the 82598 lan ports are enabled, both pcie headers return 0x80 in this field, acknowledging being part of a multi-function device. lan 0 exists as device function 0, while lan 1 exists as device function 1. if function 1 is disabled, then only a single-function device is indicated (this field returns a value of 0x00) and the lan exists as device function 0. subsystem id the subsystem id of the 82598 can be specified via an eeprom, but only a single value can be specified. the value is reflected identically for both lan devices. subsystem vendor id the subsystem vendor id of the 82598 can be specified via an eeprom, but only a single value can be specified. the value is reflected identically for both lan devices. class code, cap_ptr, max latency, min grant these fields reflect fixed values that are constant values reflected for both lan devices. device id the device id reflected for each lan device can be independently specified via an eeprom. command, status each lan device implements its own command/status registers. latency timer, cache line size each lan device implements these registers uniquely. the system should program these fields identically for each lan to ensure consistent behavior and performance of each device. memory bar, flash bar, io bar, expansion rom bar each lan device implements its own base address registers, enabling each device to claim its own address region(s). interrupt pin each lan device independently indicates which interrupt pin (inta# or intb#) is used by that device?s mac to signal system interrupts. the value for each lan device can be independently specified via an eeprom, but only if both lan devices are enabled.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 94 october 2010 ? dotted ? fields are identical to all functions ? light-blue ? read-only fields ? magenta ? hardcoded ? configuration registers are assigned one of the attributes listed in table 3-12 . table 3-12. attributes of configuration registers table 3-13. pci-compatible configuration registers r/w description ro read-only register. register bits are read-only and cannot be altered by software. rw read-write register. register bits are read-write and can be either set or reset. r/w1c read-only status, write-1b-to-clear status register; writing a 0b to r/w1c bits has no effect. ros read-only register with sticky bits. register bits are read-only and cannot be altered by software. bits are not cleared by reset and can only be reset with the pwrgood signal. devices that consume aux power are not allowed to reset sticky bits when aux power consumption (either via aux power or pme enable) is enabled. rws read-write register bits are read-write and can be either set or reset by software to the desired state. bits are not cleared by reset and can only be reset with the pwrgood signal. devices that consume aux power are not allowed to reset sticky bits when aux power consumption (either via aux power or pme enable) is enabled. r/w1cs read-only status, write-1b-to-clear status register. register bits indicate status when read, a set bit, indicating a status event, can be cleared by writing a 1b to it. writing a 0b to r/w1c bits has no effect. bits are not cleared by reset and can only be reset with the pwrgood signal. devices that consume aux power are not allowed to reset sticky bits when aux power consumption (either via aux power or pme enable) is enabled. hwinit hardware initialized. register bits are initialized by firmware or hardware mechanisms such as pin strapping or serial eeprom. bits are read-only after initialization and can only be reset (for write-once by firmware) with the pwrgood signal. rsvdp reserved and preserved. reserved for future read-write implementations; software must preserve value read for writes to these bits. rsvdz reserved and zero. reserved for future r/w1c implementations; software must use 0b for writes to these bits. byte offset byte 3 byte 2 byte 1 byte 0 0x0 device id vendor id (0x8086) 0x4 status register (0x0010) command register (0x0000) 0x8 class code (0x020000, 0x010185, 0x070002, 0x0c0701) revision id (0x03) 0xc reserved (0x00) header type (0x00 | 0x80) latency timer (0x00) cache line size (0x10) 0x10 base address 0 0x14 base address 1 0x18 base address 2 0x1c base address 3
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 95 interpretation of the various registers in the 82598 are described in the sections that follow. vendor id ? this is a read-only register that has the same value for all pci functions. it identifies unique intel products. device id ? this is a read-only register. it has the same value for the two lan functions. this field identifies unique 82598 functions. the field can be auto-loaded from the eeprom during initialization with the following default values: command reg. these are read-write registers. shaded bits are not used by this implementation and are set to 0b. each function has its own command register. 0x20 base address 4 0x24 base address 5 0x28 cardbus cis pointer (0x00000000) 0x2c subsystem id (0x0000) subsystem vendor id (0x8086) 0x30 expansion rom base address 0x34 reserved (0x000000) cap_ptr (0x40) 0x38 reserved (0x00000000) 0x3c max_latency (0x00) min_grant (0x00) interrupt pin (0x01) interrupt line (0x00) pci function default value meaning lan 0 10b6 dual port 10g/1g ethernet controller x8 pcie. lan 1 10b6 dual port 10g/1g ethernet controller x8 pcie. bit(s) initial value description 0 0b i/o access enable. 1 0b memory access enable. 20b enable mastering. lan 0 read-write field. lan 1 read-write field. 3 0b special cycle monitoring ? hardwired to 0b. 4 0b mwi enable ? hardwired to 0b. 5 0b palette snoop enable ? hardwired to 0b. 6 0b parity error response. 7 0b wait cycle enable ? hardwired to 0b.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 96 october 2010 status register ? shaded bits are not used by this implementation and are set to 0b. each function has its own status register. unless explicitly specified, entries are the same for all functions. revision ? the default revision id of this device is 0x00. the value of the rev id is a logic xor between the default value and the value in eeprom word 0x1d. note that lan 0 and lan 1 functions have the same revision id. class code ? the class code is a read-only hard-coded value that identifies the device functionality. ? lan 0, lan 1 ? 0x020000 (ethernet adapter) cache line size ? this field is implemented by pcie devices as a read-write field for legacy purposes; it has no pcie device functionality. loaded from eeprom. all functions are initialized to the same value. latency timer ? not used. hardwired to 0b. 8 0b serr# enable. 9 0b fast back-to-back enable ? hardwired to 0b. 10 0b interrupt disable. 1 15:11 0b reserved. 1. the interrupt disable register bit is a read-write bit that controls the ability of a pcie device to generate a legacy interrupt message. when set, devices are prevented from generating legacy interrupt messages. bits initial value r/w description 2:0 0b reserved. 3 0b ro interrupt status. 1 1. the interrupt status field is a ro field that indicates that an interrupt message is pending internally to the device. 41b ro new capabilities. indicates that a device implements extended capabilities. the 82598 sets this bit and implements a capabilities list to indicate that it supports pci power management msis and pcie extensions. 5 0b 66 mhz capable. hardwired to 0b. 6 0b reserved. 7 0b fast back-to-back capable. hardwired to 0b. 8 0b r/w1c data parity reported. 10:9 00b devsel timing. hardwired to 0b. 11 0b r/w1c signaled target abort. 12 0b r/w1c received target abort 13 0b r/w1c received master abort. 14 0b r/w1c signaled system error. 15 0b r/w1c detected parity error.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 97 header type ? this indicates if a device is single- or multi-function. if a single lan function is the only active one, this field has a value of 0x00 to indicate a single-function device. if other functions are enabled, this field has a value of 0x80 to indicate a multi-function device. base address registers ? the base address registers (or bars) are used to map register space of various functions. 32-bit addresses are used in one register for each memory mapping window. table 3-14. lan 0 & lan 1 functions all base address registers have the following fields: bar addr 31:4 3 2:1 0 0 0x10 memory bar (r/w ? 31:17; 0b ? 16:4) 0b 00b 0b 1 0x14 flash bar (r/w ? 31:23/16; 0b ? 22/15:4) refer to previously mentioned text regarding flash size. 0b 00b 0b 2 0x18 i/o bar (r/w ? 31:5; 0b ? 4:1) 0b 1b 3 0x1c msi-x bar (r/w ? 31:14; 0b ? 13:4) 0b 00b 0b 4 0x20 reserved (read as all 0b?s) 5 0x24 reserved (read as all 0b?s) field bit(s) r/w initial value description mem 0 r 0b for memory 1b for i/o 0b = indicates memory space. 1b = indicates i/o. mem type 2:1 r 00b indicates the address space size. 00b = 32-bit prefetch mem 3r 0b 0b = non-prefetchable space. 1b = prefetchable space. the 82598 implements non-prefetchable space since it has read side effects. memory address space 31:4 r/w 0b read-write bits are hardwired to 0b and dependent on memory mapping window sizes. ? lan memory spaces are 128 kb. ? lan flash spaces can be either 64 kb or up to 8 mb in the power of 2. mapping window size is set by eeprom word 0x0f. io address space 31:2 r/w 0b read-write bits are hardwired to 0b and dependent on i/o mapping window sizes. ? lan i/o spaces are 32 bytes
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 98 october 2010 table 3-15. memory and io mapping 3.1.1.14.3.1 expansion rom base address this register is used to define the address and size information for boot-time access to optional flash memory. it is enabled by eeprom words 0x24 and 0x14 for lan 0 and lan 1, respectively. this register returns a zero value for functions without an expansion rom window. subsystem id ? this value can be loaded automatically from the eeprom at power up with a default value of 0x0000. subsystem vendor id ? this value can be loaded automatically from the eeprom at power up or reset. a value of 0x8086 is the default for this field at power up if the eeprom does not respond or is not programmed. all functions are initialized to the same value. function mapping window mapping description lan 0 lan 1 memory bar 0 the internal registers and memories are accessed as direct memory mapped offsets from the base address register. software can access a dword or 64 bits. flash bar 1 the external flash can be accessed using direct memory mapped offsets from the flash base address register. software can access byte, word, dword or 64 bits. i/o bar 2 all internal registers, memories, and flash can be accessed using i/o operations. there are two 4- byte registers in the io mapping window: addr reg and data reg. software can access byte, word or dword. msi-x bar 3 the internal registers and memories are accessed as direct memory mapped offsets from the base address register. software can access a dword or 64 bits. 31:11 10:1 0 expansion rom bar (r/w ? 31:12316; 0b ? 22/15:1) refer to the previously mentioned text regarding flash bar. en field bit(s) r/w initial value description en 0 r/w 0b 1b = enables expansion rom access. 0b = disables expansion rom access. reserved 10:1 r 0b always read as 0b. writes are ignored. address 31:11 r/w 0b read-write bits are hardwired to 0b and dependent on the memory mapping window size. lan expansion rom spaces can be either 64 kb or up to 8 mb in the power of 2. mapping window size is set by eeprom word 0x0f. pci function default value eeprom address lan functions 0x0000 0x0b
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 99 cap_ptr ? the capabilities pointer field (cap_ptr) is an 8-bit field that provides an offset in the 82598's pci configuration space for the location of the first item in the capabilities linked list. the 82598 sets this bit, and implements a capabilities list to indicate that it supports pci power management, msis, and pcie extended capabilities. its value is 0x40, which is the address of the first entry: pci power management. interrupt pin ? read-only register. ? lan 0 / lan 1 1 - a value of 0x1/0x2 indicates that this function implements a legacy interrupt on inta/intb respectively. loaded from eeprom word 0x24/0x14 for lan 0 and lan 1, respectively. refer to the following detail for cases in which lan port(s) are disabled. interrupt line ? read/write register programmed by software to indicate which of the system interrupt request lines the 82598's interrupt pin is bound to. refer to the pci definition for more details. max_lat/min_gnt ? not used. hardwired to 0b. 3.1.1.14.4 pci power management registers all fields are reset at full power-up. all fields except pme_en and pme_status are reset after exiting from the d3cold state. if aux power is not supplied, the pme_en and pme_status fields reset after exiting from the d3cold state. refer to the detailed description below for registers loaded from the eeprom at initialization. initialization values of the configuration registers are marked in parenthesis. notation: ? dotted ? fields that are identical to all functions ? light-blue ? read-only fields ? magenta ? hardcoded and strapping option table 3-16. power management register block address item next pointer 0x40-47 pci power management. 0x50 0x50-5f message signaled interrupt. 0x60 0x60-6f extended message signaled interrupt. 0xa0 0xa0-db pcie capabilities. 0x00 1. if only a single device/function of the 82598 component is enabled, this value is ignored, and the interrupt pin field of the enabled device reports inta# usage. byte offset byte 3 byte 2 byte 1 byte 0 0x40 power management capabilities (pmc) next pointer capability id 0x44 data pmcsr_bse bridge support extensions power management control/status register (pmcsr)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 100 october 2010 the following section describes the register definitions, whether they are required or optional for compliance, and how they are implemented in the 82598. capability id ? 1 byte, offset 0x40, (ro) ? this field equals 0x01 indicating the linked list item as being the pci power management register. next pointer ? 1 byte, offset 0x41, (ro) ? this field provides an offset to the next capability item in the capability list. its value of0x50 points to msi capability. power management capabilities (pmc) ? 2 byte, offset 0x42, (ro) ? this field describes the device functionality during the power management states as listed in table 3-17 . note that each device function has its own register. table 3-17. power management capabilities (pmc) power management control/status register (pmcsr) ? 2 byte, offset 0x44, (r/w) ? this register is used to control and monitor power management events in the device. note that each device function has its own pmcsr. bits default r/w description 15:11 01001b ro pme_support. this 5-bit field indicates the power states in which the function can assert pme#. its initial value is loaded from eeprom word 0x0a. condition functionality values: ? no aux pwr pme at d0 and d3 hot = 01001b ? aux pwr pme at d0, d3 hot , and d3 cold = 11001b 10 0b ro d2_support ? 82598 does not support the d2 state. 9 0b ro d1_support ? 82598 does not support the d2 state. 8:6 000b ro aux current ? required current defined in the data register. 51b ro dsi ? 82598 requires its device driver to be executed following a transition to the d0 uninitialized state. 4 0b ro reserved. 3 0b ro pme_clock ? disabled. hardwired to 0b. 2:0 011b ro version ? 82598 complies with the pci pm specification revision 1.2.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 101 table 3-18. power management control/status (pmcsr) pmcsr_bse bridge support extensions ? 1 byte, offset 0x46, (ro) ? this register is not implemented in the 82598; values set to 0x00. data register ? 1 byte, offset 0x47, (ro) ? this optional register is used to report power consumption and heat dissipation. the reported register is controlled by the data_select field in the pmcsr; the power scale is reported in the data_scale field in the pmcsr. the data of this field is loaded from the eeprom if power management is enabled in the eeprom or with a default value of 0x00. the values for the 82598?s functions are as follows: bits default r/w description 15 0b at power up r/w1c pme_status. this bit is set to 1b when the function detects a wake-up event independent of the state of the pme_en bit. writing a 1b clears this bit. 14:13 refer to the value in the data register description that follows ro data_scale. this field indicates the scaling factor that?s used when interpreting the value of the data register. for the lan function, this field equals 01b (indicating 0.1 watt/units) and the data_select field is set to 0, 3, 4, 7, (or 8 for function 0). otherwise, it equals 00b. 12:9 0000b r/w data_select. this 4-bit field is used to select which data is to be reported through the data register and data_scale field. these bits are writeable only when power management is enabled via the eeprom. 8 0b at power up r/w pme_en. if power management is enabled in the eeprom, writing a 1b to this register enables wake up. if power management is disabled in the eeprom, writing a 1b to this bit has no effect and does not set the bit to 1b. 7:4 0000b ro reserved. 82598 returns a value of 000000b for this field. 30b ro no_soft_reset. this bit is always set to 0b to indicate that 82598 performs an internal reset upon transitioning from d3hot to d0 via software control of the powerstate bits. configuration context is lost when performing the soft reset. upon transition from the d3hot to the d0 state, a full re-initialization sequence is needed to return the 82598 to the d0 initialized state. 2 0b ro reserved for pcie. 1:0 00b r/w powerstate. this field is used to set and report the power state of a function as follows: 00b = d0. 01b = d1 (cycle ignored if written with this value). 10b = d2 (cycle ignored if written with this value). 11b = d3. function d0 (consume/ dissipate) d3 (consume/ dissipate) common data_scale/ data_select (0x0/0x4) (0x3/0x7) (0x8) 0 eep pcie control offset 6 eep pcie control offset 6 eep pcie control offset 6 01b 1 eep pcie control offset 6 eep pcie control offset 6 0x00 01b
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 102 october 2010 note: for other data_select values the data register output is reserved (0b). 3.1.1.14.5 msi configuration this structure is required for pcie devices. there are no changes to this structure from the initial values of the configuration registers. defaults are marked in parenthesis. color notation: ? dotted ? fields that are identical to all functions ? light-blue ? read-only fields ? magenta ? hardcoded table 3-19. message signaled interrupt configuration registers capability id ? 1 byte, offset 0x50, (ro) ? this field equals 0x05, indicating the linked list item as being message signaled interrupt registers. next pointer ? 1 byte, offset 0x51, (ro) ? this field provides an offset to the next item in the capability list. its value of 0x60 points to the msi-x capability. message control ? 2 byte, offset 0x52, (r/w) ? these fields are listed in table 3-20 . note that there is a dedicated register per pci function to separately enable msi. byte offset byte 3 byte 2 byte 1 byte 0 0x50 message control (0x0080) next pointer capability id (0x05) 0x54 message address 0x58 message upper address 0x5c reserved message data
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 103 table 3-20. msi message control field message address low ? 4 byte, offset 0x54, (r/w) ? written by the system to indicate the lower 32 bits of the address to use for the msi memory write transaction. the lower two bits always returns 0b regardless of the write operation. message address high ? 4 byte, offset 0x58, (r/w) ? written by the system to indicate the upper 32 bits of the address to use for the msi memory write transaction. message data ? 2 byte, offset 0x5c, (r/w) ? written by the system to indicate the lower 16 bits of the data written in the msi memory write dword transaction. the upper 16 bits of the transaction are written as 0b. 3.1.1.14.6 msi-x configuration the msi-x capability structure is in table 3-21 . note that more than one msi-x capability structure per function is prohibited; however, a function is permitted to have both an msi and an msi-x capability structure. in contrast to the msi capability structure, which directly contains all of the control/status information for the function's vectors, the msi-x capability structure instead points to an msi-x table structure and a msi-x pending bit array (pba) structure, each residing in memory space. each structure is mapped by a base address register (bar) belonging to the function that begins at 0x10 in the configuration space. a bar indicator register (bir) indicates which bar and a qword- aligned offset indicates where the structure begins relative to the base address associated with the bar. the bar can be either 32-bits or 64-bit, but must map to the memory space. a function is permitted to map both structures with the same bar or map each structure with a different bar. the msi-x table structure ( table 3-25 ) typically contains multiple entries, each consisting of several fields: message address, message upper address, message data, and vector control. each entry is capable of specifying a unique vector. the pba structure ( table 3-26 ) contains the function's pending bits, one per table entry, organized as a packed array of bits within qwords. note: the last qword will not necessarily be fully populated. bits default r/w description 0 0b r/w msi enable. 1b = message signaled interrupts. the 82598 generates an msi for interrupt assertion instead of intx signaling. 3:1 000b ro multiple messages capable. the 82598 indicates a single requested message per function. 6:4 000b ro multiple message enable. the 82598 returns 000b to indicate that it supports a single message per function. 71b ro 64-bit capable. a value of 1b indicates that the 82598 is capable of generating 64-bit message addresses. 15:8 0b ro reserved. reads as 0b
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 104 october 2010 table 3-21. msi-x capability structure capability id ? 1 byte, offset 0x60, (ro) ? this field equals 0x11 indicating that the linked list item as being the msi-x registers. next pointer ? 1 byte, offset 0x61, (ro) ? this field provides an offset to the next capability item in the capability list. its value of 0xa0 points to pcie capability. message control ? 2 byte, offset 0x62, (r/w) ? these register fields are listed in table 3-22 . table 3-22. msi-x message control field byte offset byte 3 byte 2 byte 1 byte 0 0x60 message control (0x0080) next pointer capability id (0x11) 0x64 table offset table bir 0x68 pba offset pba bir bits default r/w description 10:0 0x013 ro table size. system software reads this field to determine the msi-x table size n, which is encoded as n-1. the 82598 supports up to 20 different interrupt vectors per function. 13:11 000b ro always returns 000b on a read. a write operation has no effect. 14 0b r/w function mask. if 1b, all of the vectors associated with the function are masked, regardless of their per-vector mask bit states. if 0b, each vector?s mask bit determines whether the vector is masked or not. setting or clearing the msi-x function mask bit has no effect on the state of the per-vector mask bits. 15 0b r/w msi-x enable. if 1b and the msi enable bit in the msi message control register is 0b, the function is permitted to use msi-x to request service and is prohibited from using its intx# pin. system configuration software sets this bit to enable msi-x. a device driver is prohibited from writing this bit to mask a function?s service request. if 0b, the function is prohibited from using msi-x to request service.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 105 table 3-23. msi-x table offset table 3-24. table offset table 3-25. msi-x table structure note: in the 82598, n =16 bits default r/w description 31:3 0x000 ro table offset. used as an offset from the address contained by one of the function?s base address registers to point to the base of the msi-x table. the lower three table bir bits are masked off (set to 0b) by software to form a 32-bit qword-aligned offset. note that this field is read only. 2:0 0x3 ro table bir. indicates which one of a function?s base address registers, beginning at 0x10 in the configuration space, is used to map the function?s msi-x table into the memory space. bir value base address register: 0 = 0x10. 1 = 0x14. 2 = 0x18. 3 = 0x1c. 4 = 0x20. 5 = 0x 24. 6 = reserved. 7 = reserved. for a 64-bit base address register; the table bir indicates the lower dword. hardwired to 0b. bits default r/w description 31:3 0x0400 ro pba offset. the offset from the address contained in one of the function base address registers; points to the base of the msi-x pba. the lower three pba bir bits are masked off (set to 0b) by software to form a 32-bit qword-aligned offset. the field is read only. 2:0 0x3 ro pba bir. indicates which of a function?s base address registers, beginning at 0x10 in configuration space, is used to map the function?s msi-x pba into memory space. pba bir value definitions are identical to those for the msi-x table bir. this field is read only and set to 0b. dword3 dword2 dword1 dword0 vector control msg data msg upper addr msg addr entry 0 base vector control msg data msg upper addr msg addr entry 1 base + 1*16 vector control msg data msg upper addr msg addr entry 2 base + 2*16 ? ? ? ? ? vector control msg data msg upper addr msg addr entry (n-1) base + (n-1) *16
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 106 october 2010 table 3-26. msi-x pba structure note: in the 82598, n = 20. therefore, only qword0 is implemented. table 3-27. msi-x table structure (message address field) table 3-28. msi-x table structure (message upper address field) table 3-29. msi-x table structure (message data field) pending bits 0 through 63 qword0 base bits default type description 31:2 0x00 r/w message address. system-specified message lower address. for msi-x messages, the contents of this field from an msi-x table entry specifies the lower portion of the dword-aligned address (ad[31:02]) for the memory write transaction. this field is read/write. 1:0 0x00 r/w message address. for proper dword alignment, software must always write zeroes to these two bits; otherwise the result is undefined. the state of these bits after reset must be 0b. these bits are permitted to be read-only or read/write. bits default type description 31: 0 0x00 r/w message upper address. system-specified message upper address bits. if this field is zero, single address cycle (sac) messages are used. if this field is non-zero, dual address cycle (dac) messages are used. this field is read/write . bits default type description 31:0 0x00 r/w message data. system-specified message data. for msi-x messages, the contents of this field from an msi-x table entry specifies the data driven on ad[31:0] during the memory write transaction?s data phase. this field is read/write .
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 107 table 3-30. msi-x table structure (vector control field) to request service using a given msi-x table entry, a function performs a dword memory write transaction using the contents of the message data field entry for data, the contents of the message upper address field for the upper 32 bits of the address, and the contents of the message address field entry for the lower 32 bits of the address. a memory read transaction from the address targeted by the msi-x message produces undefined results. the msi-x table and msi-x pba are permitted to co-reside within a naturally aligned 4 kb address range, though they must not overlap with each other. msi-x table entries and pending bits are each numbered 0 through n-1, where n-1 is indicated by the table size field in the msi-x message control register. for a given arbitrary msi-x table entry k, its starting address can be calculated with the formula: entry starting address = table base + k*16 for the associated pending bit k, its address for qword access and bit number within that qword can be calculated with the formulas: qword address = pba base + (k div 64)*8 qword bit# = k mod 64 software that chooses to read pending bit k with dword accesses can use these formulas: dword address = pba base + (k div 32)*4 dword bit# = k mod 32 3.1.1.14.7 pcie configuration registers pcie provides two mechanisms to support native features: ? pcie defines a pci capability pointer indicating support for pcie ? pcie extends the configuration space beyond the 256 bytes available for pci to 4096 bytes. initialization values of the configuration registers are marked in parenthesis. color notation: dotted ? fields that are identical to all functions light-blue ? read-only fields bits default type description 31:1 0x00 r/w reserved. after reset, the state of these bits must be 0b. however, for potential future use, software must preserve the value of these reserved bits when modifying the value of other vector control bits. if software modifies the value of these reserved bits, the result is undefined. 0 1b r/w mask bit. when this bit is set, the function is prohibited from sending a message using this msi-x table entry. however, any other msi-x table entries programmed with the same vector are still capable of sending an equivalent message unless they are also masked. this bit?s state after reset is 1b (entry is masked). this bit is read/write.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 108 october 2010 magenta ? hardcoded pcie capability structure ? the 82598 implements the pcie capability structure for endpoint devices as follows: table 3-31. pcie configuration registers capability id ? 1 byte, offset 0xa0, (ro) ? this field equals 0x10 indicating that the linked list item as being the pcie capabilities registers. next pointer ? 1 byte, offset 0xa1, (ro) ? offset to the next capability item in the capability list. a 0x00 value indicates that it is the last item in the capability-linked list. pcie cap ? 2 byte, offset 0xa2, (ro) ? the pcie capabilities register identifies pcie device type and associated capabilities. this is a read-only register identical to all functions. byte offset byte 3 byte 2 byte 1 byte 0 0xa0 pcie capability register next pointer capability id 0xa4 device capability 0xa8 device status device control 0xac link capability 0xb0 link status link control 0xb4 reserved 0xb8 reserved reserved 0xbc reserved reserved 0xc0 reserved x0c4 device capability 2 0xc8 reserved device control 2 0xcc reserved 0xd0 reserved link control 2 0xd4 reserved 0xd8 reserved reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 109 device cap ? 4 byte, offset 0xa4, (ro) ? this register identifies the pcie device specific capabilities. it is a read-only register with the same value for the two lan functions and to all other functions. bits default r/w description 3:0 0010b ro capability version. indicates the pcie capability structure version. the 82598 supports both version 1 and version 2 as loaded from the pcie capability version bit in the eeprom. 7:4 0000b ro device/port type. indicates the type of pcie functions. all functions are native pci functions with a value of 0000b. 80bro slot implemented. the 82598 does not implement slot options. therefore, this field is hardwired to 0b. 13:9 00000b ro interrupt message number. the 82598 does not implement multiple msi per function. as a result, this field is hardwired to 0x0. 15:14 00b ro reserved. bits r/w default description 2:0 ro 001b max payload size supported. this field indicates the maximum payload that the 82598 can support for tlps. it is loaded from the eeprom with a default value of 256 bytes. 4:3 ro 00b reserved. 5ro0b extended tag field supported. maximum supported size of the tag field. the 82598 supports a 5-bit tag field for all functions. 8:6 ro 011b endpoint l0s acceptable latency. this field indicates the acceptable latency that the 82598 can withstand due to the transition from l0s state to the l0 state. all functions share the same value loaded from the eeprom pcie init configuration 1 bits [8:6]. a value of 011b equals 512 ns. 11:9 ro 110b endpoint l1 acceptable latency. this field indicates the acceptable latency that the 82598 can withstand due to the transition from l1 state to the l0 state. the 82598 does not support aspm l1. a value of 110b equals 32 s-64 s. 12 ro 0b attention button present. hardwired in the 82598 to 0b for all functions. 13 ro 0b attention indicator present. hardwired in the 82598 to 0b for all functions. 14 ro 0b power indicator present. hardwired in the 82598 to 0b for all functions. 15 ro 1b role based error reporting. hardwired in the 82598 to 1b for all functions. 17:16 ro 00b reserved, should be set to 00b. 25:18 ro 0x00 slot power limit value. used in upstream ports only. hardwired in the 82598 to 0x00 for all functions. 27:26 ro 00b slot power limit scale. used in upstream ports only. hardwired in the 82598 to 0b for all functions. 31:28 ro 0000b reserved.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 110 october 2010 device control ? 2 byte, offset 0xa8, (rw) ? this register controls the pcie specific parameters. note that there is a dedicated register per each function. device status ? 2 byte, offset 0xaa, (ro) ? this register provides information about pcie device specific parameters. note that there is a dedicated register per each function. bits r/w default description 0 r/w 0b correctable error reporting enable. enable error report. 1 r/w 0b non-fatal error reporting enable. enable error report. 2 r/w 0b fatal error reporting enable. enable error report. 3 r/w 0b unsupported request reporting enable. enable error report. 4 r/w 1b enable relaxed ordering. if this bit is set, the 82598 is permitted to set the relaxed ordering bit in the attribute field of write transactions that do not need strong ordering. refer to the ctrl_ext register bit ro_dis for more details. 7:5 r/w 000b (128 bytes) max payload size. this field sets the maximum tlp payload size for the 82598 functions. as a receiver, the 82598 must handle tlps as large as the set value. as a transmitter, the 82598 must not generate tlps exceeding the set value. the max payload size field supported in the device capabilities register indicates permissible values that can be programmed. 9:8 r/w 00b reserved, should be set to 00b. 10 r/w 0b auxiliary power pm enable. when set, enables the 82598 to draw aux power independent of pme aux power. the 82598 is a multi-function device, therefore allowed to draw aux power if at least one of the functions has this bit set. 11 r/w 1b enable no snoop. snoop is gated by non-snoop bits in the gcr register in the csr space. 14:12 r/w 010b max read request size. this field sets maximum read request size for the 82598 as a requester. 000b = 128 bytes. 001b = 256 bytes. 010b = 512 bytes. 011b = 1 kb. 100b = 2 kb. 101b = reserved. 110b = reserved. 111b = reserved. 15 ro 0b reserved. note: the 82598 does not issue read requests greater than 256 bytes. bits r/w default description 0 rw1c 0b correctable detected. indicates status of correctable error detection. 1 rw1c 0b non-fatal error detected. indicates status of non-fatal error detection. 2 rw1c 0b fatal error detected. indicates status of fatal error detection. 3 rw1c 0b unsupported request detected. indicates that the 82598 received an unsupported request. this field is identical in all functions. the 82598 can?t distinguish which function causes the error.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 111 link cap ? 4 byte, offset 0xac, (ro) ? this register identifies pcie link-specific capabilities. this is a read-only register identical to all functions. 4ro 0b aux power detected. if aux power is detected, this field is set to 1b. it is a strapping signal from the periphery and is identical for all functions. resets on lan power good, internal power on reset, and pe_rst_n only. 5ro 0b transaction pending. indicates whether the 82598 has any transactions pending. (transactions include completions for any outstanding non-posted request for all used traffic classes). 15:6 ro 0x00 reserved. bits r/w default description 3:0 ro 0001b supported link speeds. this field indicates the supported link speed(s) of the associated link port. defined encodings are: 0001b = 2.5 gb/s link speed supported. 0010b = 5 gb/s and 2.5 gb/s link speeds supported. 9:4 ro 0x08 max link width. indicates the maximum link width. the 82598 supports a x1, x2, x4 and x8-link width. this field is loaded from the eeprom pcie init configuration 3 word 0x1a with a default value of eight lanes. defined encoding: 000000b = reserved 000001b = x1 000010b = x2 000100b = x4 001000b = x8 11:10 ro 01b active state link pm support. indicates the level of the active state of power management supported in the 82598. defined encodings are: 00b = reserved 01b = l0s entry supported 10b = reserved 11b = l0s and l1 supported this field is loaded from the eeprom pcie init configuration 3 word 0x1a. bits r/w default description 14:12 ro 110b 1 (2 ? s ? 4 ? s) l0s exit latency. indicates the exit latency from l0s to l0 state. 000b = less than 64 ns 001b = 64 ns ? 128 ns 010b ? 128 ns ? 256 ns 011b ? 256 ns ? 512 ns 100b = 512 ns 1 ?s 101b = 1 ? s ? 2 ? s 110b = 2 ? s ? 4 ? s 111b = reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 112 october 2010 link control ? 2 byte, offset 0xb0, (ro) ? this register controls pcie link specific parameters. there is a dedicated register per each function. 17:15 ro 111b l1 exit latency. indicates the exit latency from l1 to l0 state. the 82598 does not support aspm l1. 000b = less than 1 ?s 001b = 1 ? s ? 2 ? s 010b = 2 ? s ? 4 ? s 011b = 4 ? s ? 8 ? s 100b = 8 ? s ? 16 ? s 101b = 16 ? s ? 32 ? s 110b = 32 ? s ? 64 ? s 111b = l1 transition not supported. 18 ro 0b clock power management. 19 ro 0b surprise down error reporting capable. 20 ro 0b data link layer link active reporting capable. 21 ro 0b link bandwidth notification capability. 23:22 ro 00b reserved. 31:24 hwinit 0x0 port number. the pcie port number for the given pcie link. this field is set in the link training phase. 1. loaded from the eeprom. bits r/w default description 1:0 r/w 00b active state link pm control. this field controls the active state pm supported on the link. link pm functionality is determined by the lowest common denominator of all functions. bit 0 of this field is loaded from pcie init configuration 1, offset 1, bit 15 (l0s enable). defined encodings are: 00b = pm disabled. 01b = l0s entry supported. 10b = reserved. 11b = l0s and l1 supported. 2 ro 0b reserved. 3 r/w 0b read completion boundary. 4 ro 0b link disable. not applicable for endpoint devices. hardwired to 0b. 5 ro 0b retrain clock. not applicable for endpoint devices. hardwired to 0b. 6 r/w 0b common clock configuration. when set, indicates that the 82598 and the component at the other end of the link are operating with a common reference clock. a value of 0b indicates that they are operating with an asynchronous clock. this parameter affects the l0s exit latencies. 7 r/w 0b extended sync. when set, this bit forces an extended tx of the fts ordered set in fts and an extra ts1 at the exit from l0s prior to entering l0. 8 ro 0b reserved. 9ro hardwired to 0b hardware autonomous width disable. when set to 1b, this bit disables hardware from changing the link width for reasons other than attempting to correct an unreliable link operation by reducing link width.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 113 link status ? 2 byte, offset 0xb2, (ro) ? this register provides information about pcie link specific parameters. this is a read only register identical to all functions. the following registers are supported only if the capability version is two and above. device cap 2 ? 4 byte, offset 0xc4, (ro) ? this register identifies the pcie device-specific capabilities. it is a read-only register with the same value for both lan functions. 11:10 ro 00b reserved. read only as 00b. 15:12 ro 0000b reserved. bits r/w default description 3:0 ro 0001b current link speed. this field indicates the negotiated link speed of the given pcie link. defined encodings are: 0001b = 2.5 gb/s pcie link. 0010b = 5 gb/s pcie link. all other encodings are reserved. 9:4 ro 000001b negotiated link width. indicates the negotiated width of the link. relevant encodings for the 82598 are: 000001b = x1. 000010b = x2. 000100b = x4. 001000b = x8. 10 ro 0b link training error. indicates that a link training error has occurred. 11 ro 0b link training. indicates that link training is in progress. 12 hwinit 1b slot clock configuration. when set, indicates that the 82598 uses the physical reference clock that the platform provides at the connector. this bit must be cleared if the 82598 uses an independent clock. the slot clock configuration bit is loaded from the slot_clock_cfg eeprom bit. 14:13 ro 00b reserved. read only as 00b. 15 ro 0b reserved.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 114 october 2010 device control 2 ? 2 byte, offset 0xc8, (rw) ? this register controls the pcie specific parameters. note that there is a dedicated register per each function. bits r/w default description 3:0 ro 1111b completion timeout ranges supported. this field indicates the 82598?s support for the optional completion timeout programmability mechanism. four time value ranges are defined: ? range a: 50 s to 10 ms. ? range b: 10 ms to 250 ms. ? range c: 250 ms to 4 s. ? range d: 4 s to 64 s. bits are set according to the following values to show the timeout value ranges that the 82598 supports. ? 0000b = completion timeout programming not supported. the 82598 must implement a timeout value in the range of 50 s to 50 ms. ? 0001b = range a. ? 0010b = range b. ? 0011b = ranges a and b. ? 0110b = ranges b and c. ? 0111b = ranges a, b and c. ? 1110b = ranges b, c and d. ? 1111b = ranges a, b, c and d. ? all other values are reserved. bits r/w default description 4 ro 1b completion timeout disable supported. 31:5 ro 0b reserved. bits r/w default description 3:0 rw 0b completion timeout value. for devices that support completion timeout programmability, this field enables system software to modify the completion timeout value. defined encodings: ? 0000b = default range: 50 s to 50 ms. note: it is strongly recommended that the completion timeout mechanism not expire in less than 10 ms. values available if range a (50 s to 10 ms) programmability range is supported: ? 0001b = 50 s to 100 s. ? 0010b = 1 ms to 10 ms. values available if range b (10 ms to 250 ms) programmability range is supported: ? 0101b = 16 ms to 55 ms. ? 0110b = 65 ms to 210 ms. values available if range c (250 ms to 4 s) programmability range is supported: ? 1001b = 260 ms to 900 ms. ? 1010b = 1 s to 3.5 s. values available if the range d (4 s to 64 s) programmability range is supported: ? 1101b = 4 s to 13 s. ? 1110b = 17 s to 64 s. values not defined are reserved. software is permitted to change the value of this field at any time. for requests already pending when the completion timeout value is changed, hardware is permitted to use either the new or the old value for the outstanding requests and is permitted to base the start time for each request either on when this value was changed or on when each request was issued.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 115 link control 2 ? 2 byte, offset 0xd0, (rw) 3.1.1.14.8 pcie extended configuration space pcie configuration space is located in a flat memory-mapped address space. pcie extends the configuration space beyond the 256 bytes available for pci to 4096 bytes. the 82598 decodes an additional four bits (bits 27:24) to provide the additional configuration space as shown. pcie reserves the remaining four bits (bits 31:28) for future expansion of the configuration space beyond 4096 bytes. the configuration address for a pcie device is computed using a pci-compatible bus, device, and function numbers as follows: pcie extended configuration space is allocated using a linked list of optional or required pcie extended capabilities following a format resembling pci capability structures. the first pcie extended capability is located at offset 0x100 in the device configuration space. the first dword of the capability structure identifies the capability/version and points to the next capability. 4rw0b completion timeout disable. when set to 1b, this bit disables the completion timeout mechanism. software is permitted to set or clear this bit at any time. when set, the completion timeout detection mechanism is disabled. if there are outstanding requests when the bit is cleared, it is permitted but not required for hardware to apply the completion timeout mechanism to the outstanding requests. if this is done, it is permitted to base the start time for each request on either the time this bit was cleared or the time each request was issued. 15:5 ro 0b reserved. bits r/w default description 3:0 rw see description target link speed. this field is used to set the target compliance mode speed when software is using the enter compliance bit to force a link into compliance mode. defined encodings are: 0001b = 2.5 gb/s target link speed. 0010b = 5 gb/s target link speed. all other encodings are reserved. if a value is written to this field that does not correspond to a speed included in the supported link speeds field, the result is undefined. the default value of this field is the highest link speed supported by the 82598 (as reported in the supported link speeds field of the link capabilities register) unless the corresponding platform/form factor requires a different default value. 4rw0b enter compliance. software is permitted to force a link to enter compliance mode at the speed indicated in the target link speed field by setting this bit to 1b in both components on a link and then initiating a hot reset on the link. the default value of this field following a fundamental reset is 0b. 5rw hardwired to 0b hardware autonomous speed disable. when set to 1b, this bit disables hardware from changing the link speed for reasons other than attempting to correct unreliable link operation by reducing link speed. if the 82598 does not implement the associated mechanism it is permitted to hardwire this bit to 0b. 31 28 27 20 19 15 14 12 11 2 1 0 0000b bus # device # funct # register address (offset) 00b
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 116 october 2010 the 82598 supports the following pcie extended capabilities: ? advanced error reporting capability ? offset 0x100 ? serial number capability ? offset 0x140 3.1.1.14.8.1 advanced error reporting capability the pcie advanced error reporting capability is an optional extended capability to support advanced error reporting. the tables that follow list the pcie advanced error reporting extended capability structure for pcie devices. pcie cap id register offset field description 0x00 pcie cap id pcie extended capability id. 0x04 uncorrectable error status reports error status of individual uncorrectable error sources on a pcie device. 0x08 uncorrectable error mask controls reporting of individual uncorrectable errors by device to the host bridge via a pcie error message. 0x0c uncorrectable error severity controls whether an individual uncorrectable error is reported as a fatal error. 0x10 correctable error status reports error status of individual correctable error sources on a pcie device. 0x14 correctable error mask controls reporting of individual correctable errors by device to the host bridge via a pcie error message. 0x18 advanced error capabilities and control identifies the bit position of the first uncorrectable error reported in the uncorrectable error status register. 0x1c:0x28 header log captures the header for the transaction that generated an error. bit location attribute default value description 15:0 ro 0x0001 extended capability id. pcie extended capability id indicating advanced error reporting capability. 19:16 ro 0x1 version number. pcie advanced error reporting extended capability version number. 31:20 ro 0x0140 next capability pointer. next pcie extended capability pointer.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 117 uncorrectable error status the uncorrectable error status register reports error status of individual uncorrectable error sources on a pcie device. an individual error status bit that is set to 1b indicates that a particular error occurred; software can clear an error status by writing a 1b to the respective bit. uncorrectable error mask the uncorrectable error mask register controls reporting of individual uncorrectable errors by device to the host bridge via a pcie error message. a masked error (respective bit set in mask register) is not reported to the host bridge by an individual device. note that there is a mask bit per bit of the uncorrectable error status register. bit location attribute default value description 3:0 ro 0b reserved. 4 r/w1cs 0b data link protocol error status. 11:5 ro 0b reserved. 12 r/w1cs 0b poisoned tlp status. 13 r/w1cs 0b flow control protocol error status. 14 r/w1cs 0b completion timeout status. 15 r/w1cs 0b completer abort status. 16 r/w1cs 0b unexpected completion status. 17 r/w1cs 0b receiver overflow status. 18 r/w1cs 0b malformed tlp status. 19 ro 0b reserved. 20 r/w1cs 0b unsupported request error status. 31:21 reserved 0b reserved. bit location attribute default value description 3:0 ro 0b reserved. 4 rws 0b data link protocol error mask. 11:5 ro 0b reserved. 12 rws 0b poisoned tlp mask. 13 rws 0b flow control protocol error mask. 14 rws 0b completion timeout mask. 15 rws 0b completer abort mask. 16 rws 0b unexpected completion mask.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 118 october 2010 uncorrectable error severity the uncorrectable error severity register controls whether an individual uncorrectable error is reported as a fatal error. an uncorrectable error is reported as fatal when the corresponding error bit in the severity register is set. if the bit is cleared, the corresponding error is considered fatal. if the bit is set, the corresponding error is considered non-fatal. correctable error status the correctable error status register reports error status of individual correctable error sources on a pcie device. when an individual error status bit is set to 1b it indicates that a particular error occurred; software can clear an error status by writing a 1b to the respective bit. bit location attribute default value description 17 rws 0b receiver overflow mask. 18 rws 0b malformed tlp mask. 19 ro 0b reserved. 20 rws 0b unsupported request error mask. 31:21 reserved 0b reserved. bit location attribute default value description 3:0 ro 0b reserved. 4 rws 1b data link protocol error severity. 11:5 ro 0b reserved. 12 rws 0b poisoned tlp severity. 13 rws 1b flow control protocol error severity. 14 rws 0b completion timeout severity. 15 rws 0b completer abort severity. 16 rws 0b unexpected completion severity. 17 rws 1b receiver overflow severity. 18 rws 1b malformed tlp severity. 19 ro 0b reserved. 20 rws 1b unsupported request error severity. 31:21 reserved 0b reserved.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 119 correctable error mask the correctable error mask register controls reporting of individual correctable errors by device to the host bridge via a pcie error message. a masked error (respective bit set in mask register) is not reported to the host bridge by an individual device. there is a mask bit per bit in the correctable error status register. bit location attribute default value description 0 r/w1cs 0b receiver error status. 5:1 ro 0b reserved. 6 r/w1cs 0b bad tlp status. 7 r/w1cs 0b bad dllp status. 8 r/w1cs 0b replay_num rollover status. 11:9 ro 0b reserved. 12 r/w1cs 0b replay timer timeout status. 13 r/w1cs 0b advisory non fatal error status. 15:14 ro 0b reserved. bit location attribute default value description 0 rws 0b receiver error mask. 5:1 ro 0b reserved. 6 rws 0b bad tlp mask. 7 rws 0b bad dllp mask. 8 rws 0b replay_num rollover mask. 11:9 ro 0b reserved. 12 rws 0b replay timer timeout mask. 13 rws 1b advisory non fatal error mask. 15:14 ro 0b reserved.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 120 october 2010 advanced error capabilities and control the first error pointer is a read-only register that identifies the bit position of the first uncorrectable error reported in the uncorrectable error status register. header log the header log register captures the header for the transaction that generated an error. this register is 16 bytes. 3.1.1.14.8.2 serial number the pcie device serial number capability is an optional extended capability that can be implemented by any pcie device. the device serial number is a read-only 64-bit value that is unique for a given pcie device. all multi-function devices that implement this capability must implement it for function 0; other functions that implement this capability must return the same device serial number value as that reported by function 0. table 3-32. pcie device serial number capability structure device serial number enhanced capability header (offset 0x00) table 3-33 lists the allocation of register fields in the device serial number enhanced capability header. it provides the respective bit definitions. section 3.1.1.14.8 for a description of the pcie enhanced capability header. the extended capability id for the device serial number capability is 0x0003. bit location attribute default value description 4:0 ro 0b vector pointing to the first recorded error in the uncorrectable error status register. bit location attribute default value description 127:0 ro 0b header of the packet in error (tlp or dllp). 31:0 address pcie enhanced capability header. 0x00 serial number register (lower dword). 0x04 serial number register (upper dword). 0x08 31:20 19:16 15:0 next capability offset capability version pcie extended capability id
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 121 table 3-33. device serial number enhanced capability header serial number register (offset 0x04) the serial number register is a 64-bit field that contains the ieee defined 64-bit extended unique identifier (eui-64*). figure 3-7 details the allocation of register fields in the serial number register. the table that follows figure 3-7 lists the respective bit definitions. figure 3-7. serial number register contents the serial number uses the mac address according to the following definition: bit(s) location attributes description 15:0 ro pcie extended capability id. this field is a pci-sig defined id number that indicates the nature and format of the extended capability. the extended capability id for the device serial number capability is 0x0003. 19:16 ro capability version. this field is a pci-sig defined version number that indicates the version of the capability structure present. note: must be set to 0x1 for this version of the specification. 31:20 ro next capability offset. this field contains the offset to the next pcie capability structure or 0x000 if no other items exist in the linked list of capabilities. for extended capabilities implemented in the device configuration space, this offset is relative to the beginning of pci-compatible configuration space and must always be either 0x000 (for terminating list of capabilities) or greater than 0x0ff. 31:0 serial number register (lower dword). serial number register (upper dword). 63:32 bit(s) location attributes description 63:0 ro pcie device serial number. this field contains the ieee defined 64-bit eui-64*. this identifier includes a 24-bit company id value assigned by ieee registration authority and a 40-bit extension identifier assigned by the manufacturer. field company id extension identifier order addr+0 addr+1 addr+2 addr+3 addr+4 addr+5 addr+6 addr+7 most significant byte least significant byte most significant bit least significant bit
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 122 october 2010 the serial number can be constructed from the 48-bit mac address in the following form: in this case, the mac label is 0xffff. for example, assume that the company id is (intel) 00-a0-c9 and the extension identifier is 23-45-67. in this case, the 64-bit serial number is: the mac address is the function 0 mac address that is loaded from eeprom into the ral and rah registers. note: the official document that defines eui-64* is: http://standards.ieee.org/regauth/oui/ tutorials/eui64.html note: for eeprom-less configuration, the serial number capability is not supported. 3.1.2 manageability interfaces (smbus/nc-si) the 82598 supports pass-through manageability through an on-board bmc. the bmc can be either a stand-alone device or integrated into an input/output hub (ioh). the link between the 82598 and the bmc is nc-si, smbus, or a combination of both (see table 3-34 ). table 3-34 lists the different options for the 82598 manageability links. table 3-34. 82598 manageability links field company id mac label extension identifier order addr+0 addr+1 addr+2 addr+3 addr+4 addr+5 addr+6 addr+7 most significant bytes least significant byte most significant bit least significant bit field company id mac label extension identifier order addr+0 addr+1 addr+2 addr+3 addr+4 addr+5 addr+6 addr+7 00 a0 c9 ff ff 23 45 67 most significant byte least significant byte most significant bit least significant bit configuration interfaces pass through configuration bmc legacy smbus x x dmtf standard nc-si x x nc-si back-up mode nc-si x - smbus - x
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 123 the 82598 supports two interfaces to an external bmc: ? smbus ?nc-si note: since the manageability sideband throughput is lower than the network link throughput, the 82598 allocates an 8 kb internal buffer for incoming network packets prior to being sent over the sideband interface. 3.1.2.1 smbus pass-through interface smbus is the system management bus defined by intel? corporation in 1995. it is used in personal computers and servers for low-speed system management communications. the smbus interface is one of two pass-through interfaces available in the 82598. 3.1.2.1.1 general the smbus sideband interface includes the standard smbus commands used for assigning a slave address and gathering device information for the pass-through interface. 3.1.2.1.2 pass-through capabilities when operating in smbus mode, in addition to exposing a communication channel to the lan for the bmc, the 82598 provides the following manageability services to the bmc: ? arp handling - the 82598 can be programmed to auto-arp replying for arp request packets to reduce the traffic over the bmc interconnect. ? teaming and fail-over - the 82598 can be configured to one of several teaming and fail-over configurations: ? no-teaming - the 82598 dual lan ports act independently of each other and no fail-over is provided by the 82598. the bmc is responsible for teaming and failover. ? teaming - the 82598 is configured to provide fail-over capabilities, such that manageability traffic is routed to an active port if any of the ports fail. several modes of operation are provided. note: these services are not available in nc-si mode. for more information on the smbus and nc-si manageability interfaces, refer to the intel? 82598 10 gbe controller system manageability interface application note . this document is available from your intel representative. 3.1.2.2 nc-si the nc-si interface in the 82598 is a connection to an external bmc. it operates in one of two modes: ? nc-si-smbus mode ? in conjunction with an smbus interface, where pass-through traffic passes through nc-si and configuration traffic passes through smbus. ? nc-si mode ? as a single interface with an external bmc, where all traffic between the 82598 and the bmc flows through the interface. 3.1.2.2.1 interface specification the 82598 nc-si interface meets the nc-si specification, rev. 1.2 as a phy-side device. the following nc-si capabilities are not supported by the 82598:
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 124 october 2010 ? collision detection: the interface supports only full-duplex operation ? mdio: mdio/mdc management traffic is not passed on the interface ? magic packets: magic packets are not detected at the 82598 receive end ? flow control: the 82598 supports receiving flow control on this interface but no transmission 3.1.2.2.2 electrical characteristics the 82598 complies with the electrical characteristics defined in the dmtf nc-si specification. however, the 82598 pads are not 5v tolerant and require that signals conform to 3.3v signaling. nc-si behavior is configured by the 82598 at power up: ? the output driver strength for the nc-si output signals (nc-si_dv and nc-si_rx) is configured by the eeprom nc-si data pad drive strength bit; word 15h, bit 14 (default = 0b). ? the nc-si topology is loaded from the eeprom (point-to-point or multi-drop ? default is point-to- point) the 82598 dynamically drives its nc-si output signals (nc-si_dv and nc-si_rx) as required by the sideband protocol: ? at power up, the 82598 floats the nc-si outputs. ? if the 82598 operates in point-to-point mode, then it starts driving the nc-si outputs at some time following power up. ? if the 82598 operates in a multi-drop mode, it drives the nc-si outputs as configured by the bmc. 3.1.2.2.3 nc-si transactions the nc-si link supports both pass through traffic between the bmc and the 82598 lan functions as well as configuration traffic between the bmc and the 82598 internal units. 3.1.2.2.3.1 nc-si-smbus mode nc-si serves in this mode to transfer pass-through traffic between the bmc and the lan ports. packet structure follows the rmi specification as defined in the nc-si specification. the following limitations apply: ? vlan traffic (if exists) is carried by the packet in its designated area. if vlan strip is enabled in an 82598 lan port, then the vlan tag must still exist in a vlan-enabled packet when it is sent over nc-si to the bmc. ? the fcs field must be present on any nc-si packet sent to the bmc. if packet crc strip is enabled in the 82598 lan port, the fcs field must still be there when a packet is sent over nc-si to the bmc. ? flow-control ? the 82598 does not initiate flow control over nc-si (does not send pause packets). however, the 82598 responds to flow control packets received over nc-si and meets the flow-control protocol. 3.1.2.2.3.2 nc-si mode this mode is compatible with the pre-os sideband dmtf standard.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 125 3.1.3 non-volatile memory (eeprom/flash) this section describes the eeprom and flash interfaces supported by 82598. 3.1.3.1 eeprom the 82598 uses an eeprom device to store product configuration information. the eeprom is divided into three general regions: ? hardware accessed ? loaded by the 82598 hardware after power-up, pci reset de-assertion, a d3 to d0 transition, or a software reset. ? firmware area ? includes structures used by the firmware for management configuration in its different modes. refer to the intel? 82598 10 gbe controller system manageability interface application note for configuration values ? software accessed ? used by software only. these registers are listed in this document for convenience and are only for software and are ignored by the 82598. the eeprom interface supports serial peripheral interface (spi) and expects the eeprom to be capable of 2 mhz operation. the 82598 is compatible with many sizes of 4-wire serial eeprom devices. a 4096-bit serial spi- compatible eeprom can be used. all eeproms are accessed in 16-bit words although the eeprom is designed to also accept 8-bit data accesses. the 82598 automatically determines the address size to be used with the spi eeprom it is connected to and sets the eeprom size field of the eeprom/flash control (eec) and data register (eec.ee_addr_size; bit 10). software uses this size to determine the eeprom access method. the exact size of the eeprom is stored within one of the eeprom words. the different eeprom sizes have two different numbers of address bits (8 bits or 16 bits). as a result, they must be accessed with a slightly different serial protocol. software must be aware of this if it accesses the eeprom using direct access. 3.1.3.1.1 software accesses the 82598 provides two different methods for software access to the eeprom. it can either use the built-in controller to read the eeprom or access the eeprom directly using the eeprom?s 4-wire interface. software can use the eeprom read register (eerd) to cause the 82598 to read a word from the eeprom that the software can then use. to do this, software writes the address to read into the read address field (eerd.addr; bits 15:2) and simultaneously writes a 1b to the start read bit (eerd.start; bit 0). the 82598 then reads the word from the eeprom, sets the read done bit (eerd.done; bit 1), and puts the data in the read data field (eerd.data; bits 31:16). software can poll the eeprom read register until it sees the read done bit set, then use the data from the read data field. any words read this way are not written to the 82598?s internal registers. software can also directly access the eeprom?s 4-wire interface through the eeprom/flash control register (eec). it can use this for reads, writes, or other eeprom operations. to directly access the eeprom, software should follow these steps: 1. write a 1b to the eeprom request bit (eec.ee_req; bit 6). 2. read the eeprom grant bit (eec.ee_gnt; bit 7) until it becomes 1b. it remains 0b as long as the hardware is accessing the eeprom. 3. write or read the eeprom using the direct access to the 4-wire interface as defined in the eeprom/ flash control & data register (eec). the exact protocol used depends on the eeprom placed on the board and can be found in the appropriate datasheet.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 126 october 2010 4. write a 0b to the eeprom request bit (eec.ee_req; bit 6). each time the eeprom is not valid (blank eeprom or wrong signature), software should use the direct access to the eeprom through the eec register. 3.1.3.1.2 signature field the only way the 82598 can discover whether an eeprom is present is by trying to read the eeprom. the 82598 first reads the eeprom control word at address 0x0. the 82598 checks the signature value for bits 7 and 6. if bit 7 is 0b and bit 6 is 1b, it considers the eeprom to be present and valid and reads additional eeprom words and programs its internal registers based on the values read. otherwise, it ignores the values it read from that location and does not read any other words. 3.1.3.1.3 protected eeprom space the 82598 provides to the host a mechanism for a hidden area in the eeprom. the hidden area cannot be accessed via the eeprom registers in the csr space. it can be accessed only by the manageability (mng) subsystem. for more information on the mng subsystem, refer to the intel? 82598 10 gbe controller system manageability interface application note. after the eeprom is configured to be protected, changing bits that are protected require specific manageability instructions with authentication mechanism. this mechanism is defined in the intel? 82598 10 gbe controller system manageability interface application note. 3.1.3.1.3.1 initial eeprom programming in most applications, initial eeprom programming is done directly on the eeprom pins. nevertheless, it is desirable to enable existing software utilities (accessing the eeprom via the host interface) to initially program the whole eeprom without breaking the protection mechanism. following a power-up sequence, the 82598 reads the hardware initialization words in the eeprom. if the signature in word 0x0 does not equal 01b the eeprom is assumed as non-programmed. there are two effects for non- valid signature: ? the 82598 stops reading eeprom data and sets the relevant registers to default values. ? the 82598 enables access to any location in the eeprom via the eeprom csr registers. 3.1.3.1.3.2 eeprom protected areas the 82598 defines two protected areas in the eeprom. the first area is words 0x00-0x0f these words hold the basic configuration and the pointers to all other configuration sections. the second area is a programmable size area located at the end of the eeprom and targeted at protecting the appropriate sections that should be blocked for changes. 3.1.3.1.3.3 activating the protection mechanism following an 82598 initialization, it reads the init control word from the eeprom. it then turns on the protection mechanism if word 0x0h [7:6] contains a valid signature (equals 01b) and bit 4 in word 0x0 is set to 1b (enable protection). once the protection mechanism is turned on, word 0x0 becomes write- protected and the area that is defined by word 0x0 becomes hidden (for example, read/write protected). although possible by configuration, it is prohibited that the software section in the eeprom be included as part of the eeprom protected area.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 127 3.1.3.1.3.4 non permitted accesses to protected areas in the eeprom this section refers to eeprom accesses via the eec (bit banging) or eerd (parallel read access) registers. following a write access to the write protected areas in the eeprom, the hardware responds properly on the pcie bus, but does not initiate any access to the eeprom. following a read access to the hidden area in the eeprom (as defined by word 0x0), the hardware does not access the eeprom and returns meaningless data to the host. using bit banging, the spi eeprom can be accessed in a burst mode. for example, providing an opcode address and then reading or writing data for multiple bytes. the hardware inhibits an attempt to access the protected eeprom locations even in burst accesses. software should not access the eeprom in a burst write mode starting in a non protected area and continue to a protected one. in such a case, it is not guaranteed that the write access to any area ever takes place. 3.1.3.1.4 eeprom recovery the eeprom contains fields that if programmed incorrectly might affect the functionality of 82598. the impact can range from incorrectly setting a function like led programming, disabling an entire feature like no manageability or link disconnection, to the inability to access the 82598 via the regular pcie interface. the 82598 implements a mechanism that enables a recovery from a faulty eeprom no matter what the impact is by using an smbus message that instructs the firmware to invalidate the eeprom. this mechanism uses an smbus message that the firmware is able to receive in all modes, no matter what the content of the eeprom is (even in diagnostic mode). after receiving this kind of message, the firmware clears the signature of the eeprom in word 0x0 bit 7/6 to 00b. afterwards, the bios/ operating system initiates a reset to force an eeprom auto-load process that fails and enables access to the 82598. firmware is programmed to receive such a command only from a pcie reset until one of the functions changes it status from d0u to d0a. once one of the functions switches to d0a, it can be safely assumed that the 82598 is accessible to the host and there is no more need for this function. this reduces the possibility of malicious software to use this command as a back door and limits the time the firmware must be active in non-manageability mode. the command is sent on a fixed smbus address of 0xc8. the format of the command is smbus write data byte as follows: after receiving a release eeprom command, firmware should keep its current state. it is the responsibility of the programmer updating the eeprom to send a firmware reset, if required, after the full eeprom update process completes. data byte 0xb6 is the lsb of the 82598?s default device id. an additional command is introduced to enable the eeprom write directly from the smbus interface to enable the eeprom modification (writing from the smbus to any mac csr register). the same rules as for the release eeprom command that determine when the firmware accepts this command apply to this command as well. function command data byte release eeprom 1 1. this solution requires a controllable smbus connection to the 82598. if more than one 82598 is in a state to accept this solution, then all the 82598s connected to the same smbus accepts the command. the 82598s in d0u release the eeprom. 0xc7 0xb6
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 128 october 2010 the command is sent on a fixed smbus address of 0xc8. the format of the command is smbus block write is as follow: the msb in configuration address 2 indicates which port is the target of the access (0 or 1). the 82598 always enables the manageability block after power up. the manageability clock is stopped if the manageability function is disabled in the eeprom and one of the functions had transitioned to d0a; otherwise, the manageability block gets the clock and is able to wait for the new command. this command enables writing to any mac csr register as part of the eeprom recovery process. this command can also be used to write to the eeprom and update different sections in it. 3.1.3.2 flash the 82598 provides an interface to an external serial flash/rom memory device. this flash/rom device can be mapped into memory and/or i/o address space for each lan device through the use of base address registers (bars). the eeprom bit associated with each lan device selectively disables/ enables whether the flash can be mapped for each lan device by controlling the bar register advertisement and write ability. 3.1.3.2.1 flash interface operation the 82598 provides two different methods for software access to the flash. using legacy flash transactions, the flash is read from, or written to, each time the host processor performs a read or a write operation to a memory location that is within the flash address mapping or at boot via accesses in the space indicated by the expansion rom base address register. all accesses to the flash require the appropriate command sequence for the 82598 used. refer to the specific flash data sheet for more details on reading from or writing to flash. accesses to the flash are based on a direct decode of processor accesses to a memory window defined in either: ? the 82598?s flash base address register (pcie control register at offset 0x14 or 0x18). ? a certain address range of the ioaddr register defined by the io base address register (pcie control register at offset 0x18 or 0x20). ? the expansion rom base address register (pcie control register at offset 0x30). the 82598 controls accesses to the flash when it decodes a valid access. note: flash read accesses must always be assembled by the 82598 each time the access is greater than a byte-wide access. the component byte reads or writes to the flash take on the order of 2 ? s; it continues to issue retry accesses during this time. the 82598 supports only byte writes to the flash. another way for software to access the flash is directly using the flash's 4-wire interface through the flash access register (fla). it can use this for reads, writes, or other flash operations (accessing the flash status register, erase, etc.). function cmd byte count data 1 data 2 data 3 data 4 ? data 7 eeprom write 0xc8 7 config address 2 config address 1 config address 0 config data msb ? config data lsb
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 129 to directly access the flash, software needs to: ? write a 1b to the flash request bit (fla.fl_req) ? read the flash grant bit (fla.fl_gnt) until it = 1b. it remains 0b as long as there are other accesses to the flash. ? write or read the flash using the direct access to the 4-wire interface as defined in the flash access register (fla). the exact protocol used depends on the flash placed on the board and can be found in the appropriate flash datasheet. ? write a 0b to the flash request bit (fla.fl_req). 3.1.3.2.2 flash write control the flash is write controlled by the fwe bits in the eeprom/flash control and data register (eec.fwe). note that attempts to write to the flash device when writes are disabled (fwe = 01b) should not be attempted. behavior after such an operation is undefined and can result in component and/or system hangs. after sending a one byte write to the flash, software checks if it can send the next byte to write (check if the write process in the flash had finished) by reading the flash access register. if the bit (fla.fl_busy) in this register is set, the current write did not finish. if bit (fla.fl_busy) is cleared, then software can continue and write the next byte to the flash. 3.1.3.2.3 flash erase control when software needs to erase the flash, it sets bit fla.fl_er in the flash access register to 1b (flash erase) and then set bit eec.fwe in the eeprom/flash control register to 0b. hardware gets this command and sends the erase command to the flash. note that the erase process completes automatically. software should wait for the end of the erase process before any further access to the flash. this can be checked by using the flash write control mechanism. the op-code used for erase operation is defined in the flashop register. sector erase by software is not supported. in order to delete a sector, the serial (bit bang) interface should be used. 3.1.3.2.4 flash access contention the 82598 implements internal arbitration between flash accesses initiated through the lan 0 device and those initiated through the lan 1 device. if accesses from both lan devices are initiated during the same approximate size window, the first one is served first and only then the next one. note that the 82598 does not synchronize between the two entities accessing the flash though contentions caused from one entity reading and the other modifying the same locations is possible. to avoid this contention, accesses from both lan devices should be synchronized using external software synchronization of the memory or i/o transactions responsible for the access. it might be possible to ensure contention-avoidance simply by nature of software sequence. 3.1.4 network interface 3.1.4.1 10 gbe interface the 82598 provides a complete function supporting 10 gb/s implementations. the device performs all of the functions required for transmission and reception handling called out in the different standards.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 130 october 2010 a lower-layer phy interface is included to attach either to external pma or physical medium dependent (pmd) components. the 10 gbe attachment unit interface (xaui) supports 12.5 gb/s operations through its four lane differential pairs serdes transceiver paths. when in xaui mode, the 82598 provides the full pcs and pma implementations (through xgxs) including 8b/10b coding, transmit idle randomizer, serdes, receive synchronization and lanes deskew. this interface has 3.125 gb/s 4-bit data lanes for both receive and transmit. the clock at transmit serdes operates at 3.125 ghz. the receive circuitry performs the clock and data recovery. after each lane is synchronized, a deskew mechanism is applied and each lane is aligned properly. 3.1.4.1.1 xgxs ? pcs/pma the xgmii extender sub layer (xgxs) is inserted between the xgmii and xaui. the source xgxs converts bytes on an xgmii lane into a self clocked, serial, 8b/10b encoded data stream. each of the four encoded lanes is transmitted across one of the four xaui lanes (byte striping). the destination xgxs converts the xaui data stream back into xgmii signals and deskew the four independently clocked xaui lanes into the single-clock xgmii. the source xgxs converts xgmii idle control characters into an 8b/10b code_sets. the destination xgxs can add to or delete from the interframe as needed for clock rate disparity compensation prior to converting the interframe code sequence back into xgmii idle control characters. xgxs is the common logic components of pcs and pma in the 10gbase-x definition. if external serial pma phy is attached then xgxs is served as an extender (not the final pcs or pma functions) from the 82598 to external xgxs component.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 131 figure 3-8. lan csma/cd layers 3.1.4.2 gbe interface in addition to supporting 10 gb/s operations, the 82598 also supports a 1 gbe interface. to support 1 gbe operation, one of the xaui lanes operates at 1.25 gb/s. all the other 3 xaui lanes are powered down to electrical idle (output level <50 mv). 3.1.4.3 auto negotiation and link setup features the method for configuring the link between two link partners is highly dependent on the mode of operation as well as the functionality provided by the specific physical layer device. 3.1.4.3.1 link configuration the 82598 network interface meets industry specifications for: ? 10 gbe ? xaui (802.3ae)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 132 october 2010 ? 10 gbe ? cx4 (802.3ak) ? 1 gbe backplane ? ethernet kx (802.3ap) ? ethernet bx (picmg3.1) ? 10 gbe backplane ? ethernet kx4 (802.3ap) the analog interface is configured to the appropriate electrical specification mode (according to the configuration specified in the eeprom/autoc). additional analog configuration to the core block is also possible. 3.1.4.3.2 mac link setup and auto negotiation the mac block in the 82598 supports both 10 gb/s and 1 gb/s link modes and the appropriate functionality specified in the standards for these link modes. each of these link modes can use different pmd sub-layer and base band medium types. in 10 gb/s, there's also support for 10 gb/s attachment unit interface (xaui). which of these link speeds is used can be determined through static configuration (force) or auto negotiation, as defined in 802.3ap specification clause 73, the auto negotiation process defined in the specification enables the choosing between kx4 (10g) and kx (1g) types. the 82598 also supports the 1 gb/s auto negotiation as defined in 802.3 specification clause 37 to support the auto negotiation function when configured to work as ethernet bx (picmg). link setting is done by configuring the speed configuration and auto negotiation in autoc.lms and restarting auto negotiation by setting autoc.restartan to 1b. 3.1.4.3.3 hardware detection of non-auto negotiation partner the 82598 also supports parallel detection. parallel detection is available in parallel to auto negotiation to determine the link mode (kx4 or kx) by activating kx4 and kx alternately and trying to achieve a sync indication from the related pcs this is done as part of the auto negotiation to enable link with legacy devices (that do not support auto negotiation). 3.1.4.4 mdio/mdc 3.1.4.4.1 mdio direct access the management data interface is accessed through registers msca and msrwd. a single management frame is sent by setting bit msca.30 to logic 1 and this bit is auto cleared when the frame is done. for old format write operations, the data for the write is first set up in register msrwd bits 15:0. the next step is to initialize register msca with the appropriate control information (start, op code, etc.) and with bit 30 set to logic 1. bit 30 is reset to logic 0b when both the frame is complete. the steps for old format read operations is identical except that the data in address msrwd bits (15:0) is ignored and the data read from the external device is stored in register msrwd bits (31:16). new format operations must be performed in two steps. the address portion of the pair of frames is sent by setting register msca bits (15:0) to the desired address, bits (29:28) to 00b which is the start code that identifies new format, and bits (27:26) to 00b which specifies the address portion of the new frame format. a second data frame must be sent after the address frame completes. this second frame is like the old format reads and writes for op codes 01b and 10b. another op code of 11b is defined which acts like a read operation except that the external device provides the read data from the register pointed to by the last new format address it used and then the address is incremented.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 133 the output mng_mdi_inprog goes high if enabled using register msca bit 31 when the command is written to register msca bit 30. it stays high until the management frame is complete. 3.1.4.5 ethernet (legacy) flow control flow control as defined in 802.3x, as well as the specific operation of asymmetrical flow control defined by 802.3z, is supported by the 82598. the following four registers are defined for the implementation of flow control: ? flow control receive thresh high (fcrth0) ? 13-bit high water mark indicating receive buffer fullness ? flow control receive thresh low (fcrtl0) ? 13-bit low water mark indicating receive buffer emptiness ? flow control transmit timer value (fcttv0) ? 16-bit timer value to include in transmitted pause frame ? flow control refresh threshold value (fcrtv0) ? 16-bit pause refresh threshold value flow control is implemented as a means of reducing the possibility of receive buffer overflows, which result in the dropping of received packets, and allows for local controlling of network congestion levels. this might be accomplished by sending an indication to a transmitting station of a nearly full receive buffer condition at a receiving station. the implementation of asymmetric flow control allows for one link partner to send flow control packets while being allowed to ignore their reception. for example, not required to respond to pause frames. 3.1.4.5.1 mac control frames and reception of flow control packets three comparisons are used to determine the validity of a flow control frame: 1. a match on the six byte multicast address for mac control frames or to the station address of the device (receive address register 0). 2. a match on the type field. 3. a comparison of the mac control opcode field. the 802.3x standard defines the mac control frame multicast address as 01-80-c2-00-00-01. a value of 0x8808 is compared against the flow control packet's type field to determine if it is a valid flow control packet: xon or xoff. the final check for a valid pause frame is the mac control opcode. at this time only the pause control frame opcode is defined. it has a value of 0x0001. frame-based flow control differentiates xoff from xon based on the value of the pause timer field. non-zero values constitute xoff frames while a value of zero constitutes an xon frame. values in the timer field are in units of slot time. a slot time is hard wired to 64 byte times, or 512 ns. xon frame signals the cancellation of the pause from initiated by an xoff frame. pause for zero slot times. the receiver is enabled to receive flow control frames if flow control is enabled via the rfce bit in the fctrl register. flow control capability must be negotiated between link partners via the auto negotiation process. it is the driver responsibility to reconfigure the flow control configuration after the auto negotiation process was resolved as it might modify the value of these bits based on the resolved capability between the local device and the link partner.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 134 october 2010 once the receiver has validated the reception of an xoff, or pause frame, the device performs the following: ? increment the appropriate statistics register(s) ? set the txoff bit in the tfcs register ? initialize the pause timer based on the packet's pause timer field ? disable packet transmission or schedule the disabling of transmission after the current packet completes. resuming transmission might occur under the following conditions: ? expiration of the pause timer ? reception of on xon frame (a frame with its pause timer set to 0b) both conditions clear the txoff status bit in the transmit flow control status register and transmission can resume. hardware records the number of received xon frames. 3.1.4.5.2 discard pause frames and pass mac control frames two bits in the receive control register are implemented specifically for control over receipt of pause and mac control frames. these bits are discard pause frames (dpf) and pass mac control frames (pmcf). the dpf bit forces the discarding of any valid pause frame addressed to the device's station address. if the packet is a valid pause frame and is addressed to the station address (receive address [0]), the device does not pass the packet to host memory if the dpf bit is set to logic high. however, if a flow control packet is sent to the station address, and is a valid flow control frame, it is transferred when dpf bit is set to 0b. this bit has no affect on pause operation, only the dma function. the pmcf bit allows for the passing of any valid mac control frames to the system, which does not have a valid pause opcode. in other words, the frame must have the correct mac control frame multicast address (or the mac station address), but does not have the defined pause opcode of 0x0001. frames of this type are dma'd to host memory when pmcf is logic high. 3.1.4.5.3 transmission of pause frames similar to the reception flow control packets mentioned above, xoff packets might be transmitted only if this configuration has been negotiated between the link partners via the auto negotiation process. in other words, the setting of this bit by the driver indicates the desired configuration. the content of the flow control receive threshold high register determines at what point hardware transmits first a pause frame. hardware monitors the fullness of the receive fifo and compares it with the contents of fcrth. when the threshold is reached, hardware sends a pause frame with its pause time field equal to fcttv. at this time, the hardware starts counting an internal shadow counter (reflecting the pause timeout counter at the partner end) from zero. when the counter reaches the value indicated in fcrtv register, then, if the pause condition is still valid (meaning that the buffer fullness is still above the low watermark), an xoff message is sent again. once the receive buffer fullness reaches the low water mark, hardware sends an xon message (a pause frame with a timer value of zero). software enables this capability with the xone field of the fcrtl. hardware sends a pause frame if it has previously sent one and the fifo overflows. this is intended to minimize the amount of packets dropped if the first pause frame did not reach its target.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 135 3.1.4.6 mac speed change at different power modes normal speed negotiation drives to establish a link at the highest possible speed. the the 82598 supports an additional mode of operation, where the mac drives to establish a link at a low speed. the link-up process allows a link to come up at any possible speed in cases where power is more important than performance. different behavior is defined for the d0 state and the other non-d0 states. the 82598 might initiate auto negotiation w/o direct driver command in the following cases: ? when the state of main_pwr_ok pin changes. ? when the mng_veto bit value changes. ? on a transition from d0a state to a non-d0a state, or from a non-d0a state to d0a state. the following figure shows the behavior when going to low power mode. figure 3-9. transition to low-power mode the following figure shows the behavior when going to power-up mode.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 136 october 2010 figure 3-10. transition to power-up mode 3.2 initialization 3.2.1 power up 3.2.1.1 power-up sequence the following figure shows the 82598?s power-up sequence from power ramp up and until it is ready to accept host commands.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 137 figure 3-11. 82598 power-up sequence
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 138 october 2010 3.2.1.2 power-up timing diagram figure 3-12. power-up timing diagram table 3-35. references for power-up tuning diagram note description 1 base156 clock is stable t xog after the power is stable. 2 internal reset is released after all power supplies are good and t ppg after base156 is stable. 3 nvm read starts on the rising edge of internal power on reset or lan_pwr_good. 4 sections ? eeprom init and analog configurations are loaded from nvm to configure pll and core rx/tx parameters and to get indication if manageability/wake up are enabled. 5 pll clock is stable. 6 sections eeprom core and eeprom mac are read from nvm to configure mac, manageability and wake up (if manageability /wake up enabled). 7 apm wake up and/or manageability active based on nvm contents (if manageability /wake up enabled). 8 the pcie reference clock is valid t pwrgd-clk before de-asserting pe_rst_n (according to pcie spec). 9 pe_rst_n is de-asserted t pvpgl after power is stable (according to pcie spec). 10 de-asserting pe_rst_n causes the nvm to be re-read. 11 sections eeprom core, eeprom mac, pcie analog, eeprom pcie general configuration, and eeprom pcie configuration space are read from nvm to configure pcie and mac. 12 link training starts after t pgtrn from pe_rst_n de-assertion. 13 a first pcie configuration access might arrive after t pgcfg from pe_rst_n de-assertion.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 139 3.2.1.2.1 timing requirements the 82598 requires the following start-up and power state transitions. table 3-36. start-up and power-state transitions note: it is assumed that the external 156.25 clock source is stable after the power is applied; the timing for that is part of t xog . 3.2.1.2.2 timing guarantees the 82598 guarantees the following start-up and power state transition related timing parameters. note description 14 a first pci configuration response can be sent after t pgres from pe_rst_n de-assertion. 15 writing a 1b to the memory access enable bit in the pci command register transitions the 82598 from d0u to d0 state. parameter description min max. notes t xog base 156 clock stable from power stable 10 ms t pwrgd-clk pcie clock valid to pcie power good 100 ? s - according to pcie spec t pvpgl power rails stable to pcie pwrgd active 100 ms - according to pcie spec t pgcfg external pwrgd signal to first configuration cycle. 100 ms according to pcie spec
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 140 october 2010 table 3-37. timing parameters 3.2.1.3 reset operation the 82598 reset sources are as follows: ? lan_pwr_good or internal power on reset ? the 82598 has an internal mechanism for sensing the power pins. once the power is up, a stable 82598 creates an internal reset, this reset acts as a master reset of the entire 82598. it is level sensitive, and while it is 0b, holds all registers in reset. lan_pwr_good or internal power on reset is interpreted as an indication that the 82598 power supplies are all stable. note that lan_pwr_good or internal power on reset changes state during system power-up. ? pe_rst_n ? asserting pe_rst_n indicates that both the power and the pcie clock sources are stable. this pin also asserts an internal reset after a d3cold exit. most units are reset on the rising edge of pe_rst_n. the only exception is the gio unit, which is kept in reset while pe_rst_n is de-asserted (level). ? in-band pcie reset ? the 82598 generates an internal reset in response to a phy message from the pcie or when the pcie link goes down (entry to polling or detect state). this reset is equivalent to pci reset in previous (pci) gbe controllers. ? d3hot to d0 transition ? this is also known as acpi reset. the 82598 generates an internal reset on the transition from d3hot power state to d0 (caused after configuration writes from d3 to d0 power state). note that this reset is per function and resets only the function that transitioned from d3hot to d0. ? software reset ? software can reset the 82598 by writing the device reset bit of the device control register (ctrl.rst). the 82598 re-reads the per-function eeprom fields after software reset. bits that are normally read from the eeprom are reset to their default hardware values. note that this reset is per function and resets only the function that received the software reset. pci configuration space (configuration and mapping) of the 82598 is unaffected. prior to issuing a software reset, the software device driver needs to execute the master disable algorithm. ? link reset ? software can reset the 82598 mac by writing the link reset bit of the device control register (ctrl.lrst). the 82598 re-reads the per-function eeprom fields after link reset. bits that are normally read from the eeprom are reset to their default hardware values. note that this reset is per function and resets only the function that received the link reset. note that the 82598 executes a software reset each time link reset is asserted. link reset can also be referred as mac reset. prior to issuing link reset, the software device driver needs to execute the master disable algorithm. parameter description min max. notes t xog xosc stable from power stable 10 ms t ppg internal power good delay from valid power rail 35 ms 35 ms t ee eeprom read duration 20 ms t pgtrn pcie pwrgd to start of link training 20 ms according to pcie spec t pgres external pwrgd to response to first configuration cycle 1 s according to pcie spec
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 141 ? firmware (fw) reset ? this reset is activated by writing a 1b to the fwr bit in the host interface control (hicr) register, or is being asserted by the firmware code or by the internal watchdog expiration. the resets affect the following registers and logic: table 3-38. 82598 reset effects 1. if aux_pwr = 0b the wakeup context is reset (pme_status and pme_en bits should be 0b at reset if the 82598 does not support pme from d3cold). 2. the following register fields do not follow the general rules previously stated: a. sdp registers ? reset on internal power on reset or lan_pwr_good only. b. led configuration registers c. the aux power detected bit in the pcie device status register is reset on internal power on reset, lan_pwr_good, and pe_rst_n only d. fla ? reset on internal power on reset or lan_pwr_good only. reset name common resets per function resets reset activation internal power on reset or lan_ pwr_ good pe_ rst_n in- band pcie reset d3hot? d0 sw reset link reset fw reset notes eeprom read (global) x eeprom read (pcie) x eeprom read (per function) x x x x ltssm (back to detect/polling) x x x pcie link data path x x x pci configuration registers ro x x x pci configuration registers r/w x x x x data path, memory space x x x x x x 2 mac, pcs, auto negotiation x x 6 x 6 x 6 x 6 x wake up (pm) context x x 1,3 wake up/manageability control/status registers x 4,5 manageability unit x x strapping pins x x x
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 142 october 2010 e. rah/ral[n, where n>0], mta[n], vfta[n], wupm[n], ffmt[n], ffvt[n], tdbah/tdbal, and rdbah/rdval registers have no default value. if the functions associated with the registers are enabled they must be programmed by software. once programmed, their value is preserved through all resets as long as power is applied.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 143 3. the wake-up context is defined in the pci bus power management interface specification (sticky bits). it includes: a. pme_en bit of the power management control/status register (pmcsr). b. pme_status bit of the power management control/status register (pmcsr). c. aux_en in the pcie registers d. the device requester id (since it is required for the pm_pme tlp). note: the shadow copies of these bits in the wake up control (wuc) register are treated identically. 4. refers to bits in the wuc register that are not part of the wake-up context (the pme_en and pme_status bits). 5. the wake up status (wus) registers include the following: a. wus register b. wake up packet length (wupl). c. wake up packet memory (wupm). 6. the mac cluster is reset by the appropriate event only if the manageability unit is disabled and the host is in a low power state with wol disabled. 3.2.2 specific function enable/disable 3.2.2.1 general for a lom design, it might be desirable for the system to provide bios-setup capability for selectively enabling or disabling lom devices. this might allow a programmer more control over system resource- management, avoid conflicts with add-in nic solutions, etc. the 82598 provides support for selectively enabling or disabling one or both lan device(s) in the system. 3.2.2.2 overview device presence (or non-presence) must be established early during bios execution, in order to ensure that bios resource-allocation (of interrupts, memory or i/o regions) is done according to devices that are present only. this is frequently accomplished using a bios configuration values driven on reset (cvdr) mechanism. the 82598 lan-disable mechanism is implemented in order to be compatible with such a solution. the 82598 samples two pins (pin strapping) on reset to determine the lan-enable configuration. in addition, the 82598 supports the disabling of one of the pci functions using eeprom configuration. lan disabling can be done at two different levels. either the lan is disabled completely using the lanx_dis_n pin, or the function is not apparent on the pcie configuration space using a configuration eeprom bit. in this case, the lan function is still available for manageability accesses. when a particular lan is fully disabled, all internal clocks to that lan are disabled. as a result, the 82598 is held in reset and the function presents itself as a dummy device (see table 3-39 ). the sensing of the lanx_dis_n pins is done after pcie reset (either pe_rst_n or in-band reset). as mentioned, one pci function can be enabled or disabled according to the eeprom configuration. two bits in the eeprom map indicate which function is disabled. an additional eeprom bit enables the swap between the two lan functions. note: only one function can be disabled through the eeprom for manageability use.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 144 october 2010 it is recommended to keep all the functions at their respective location, even when other functions are disabled. if function #0 (either lan0 or lan1) is disabled, then it does not disappear from the pcie configuration space. rather, the function presents itself as a dummy function. the device id and class code of this function changes to other values (dummy function device id 0x106a, class code 0xff0000). in addition, the function does not require any memory or i/o space, and does not require an interrupt line. table 3-39. pci functions index 3.2.2.3 event flow for enable/disable functions this section describes the driving levels and event sequence for 82598 functionality. following an internal power on reset/lan_pwr_good/pe_rst_n/in-band reset, the lanx_dis_n signals should be driven high (or left open) for nominal operation. if any of the lan functions are not required statically, its associated disable strapping pin can be tied statically to low. 3.2.2.3.1 bios disable the lan function at boot time by using strapping option 1. assume that following a power up sequence lanx_dis_n signals are driven high. 2. pcie is established following the pe_rst_n. 3. bios recognizes that a lan function in the 82598 should be disabled. 4. the bios drives the lanx_dis_n signal to the low level. 5. bios issues pe_rst_n or an in-band pcie reset. pci function # lan function select function 0 function 1 dummy function enable both lan functions are enabled 0 lan 0 lan 1 1 both lan functions are enabled 1 lan 1 lan 0 1 lan 0 is disabled 0 dummy lan1 1 lan 0 is disabled (pin) 1 lan 1 disable 1 lan 1 is disabled (pin) 0 lan 0 disable 1 lan 1 is disabled 1 dummy lan 0 1 both lan functions are disabled all pci functions are disabled entire 82598 is at deep power down 1 both lan functions are enabled 0 lan 0 lan 1 0 both lan functions are enabled 1 lan 1 lan 0 0 lan 0 is disabled 0 lan 1 disable 0 lan 0 is disabled (pin) 1 lan 1 disable 0 lan 1 is disabled (pin) 0 lan 0 disable 0 lan 1 is disabled 1 lan 0 disable 0 both lan functions are disabled all pci functions are disabled entire 82598 is at deep power down 0
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 145 6. as a result, the 82598 samples the lanx_dis_n signals, disables the lan function, and issues an internal reset to this function. 7. bios might start with the device enumeration procedure (the disabled lan function is invisible ? changed to dummy function). 8. proceed with normal operation. 9. re-enabling could be done by driving the lanx_dis_n signal high and then request the programmer to issue a warm boot to initialize new bus enumeration. 3.2.2.3.2 multi-function advertisement if one of the lan devices is disabled and function 0 is the only active function, the 82598 no longer is a multi-function device. the 82598 normally reports a 0x80 in the pci configuration header field header type , indicating multi-function capability. however, if a lan id is disabled and only function 0 is active, the 82598 reports a 0x0 in this field to signify single-function capability. 3.2.2.3.3 interrupt use when both lan devices are enabled, the 82598 uses both the inta# and intb# pins for interrupt reporting. the eeprom configuration controls which of these two pins are used for each lan device. the specific interrupt pin used is reported in the pci configuration header interrupt pi n field associated with each lan device. however, if either lan device is disabled, then the inta# must be used for the remaining lan device, therefore the eeprom configuration must be set accordingly. under these circumstances, the interrupt pin field of the pci header always reports a value of 0x1, indicating inta# usage. 3.2.2.3.4 power reporting when both lan devices are enabled, the pci power management register block has the capability of reporting a common power value. the common power value is reflected in the data field of the pci power management registers. the value reported as common power is specified via an eeprom field and is reflected in the data field each time the data_select field has a value of 0x8 (0x8 = common power value select). when one of lan ports is disabled and the 82598 appears as a single-function device, the common power value, if selected, reports 0x0 (undefined value), as common power is undefined for a single- function device. 3.2.2.4 device disable overview when both lan ports are disabled following an internal power on reset/pe_rst_n/ in-band reset, the lanx_dis_n signals should be tied statically to low. at this state the 82598 is disabled, lan ports are powered down, all internal clocks are shut down, and the pcie connection is powered down (similar to l2 state). 3.2.2.4.1 bios disable the device at boot time by using strapping option 1. assume that following a power up sequence lanx_dis_n signals are driven high. 2. the pcie is established following the pe_rst_n. 3. bios recognizes that the 81598 should be disabled. 4. the bios drives the lanx_dis_n signals to the low level. 5. bios issues pe_rst_n or an in-band pcie reset. 6. as a result, the 82598 samples the lanx_dis_n signals, disables the lan ports, and the pcie connection.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 146 october 2010 7. re-enabling could be done by driving at least one of the lanx_dis_n signals high and then issue a pe_rst_n to restart the 82598. 3.2.3 software initialization and diagnostics this section discusses general software notes for the 82598, especially initialization steps. this includes general hardware power-up state, basic device configuration, initialization of transmit and receive operation, link configuration, software reset capability, statistics, and diagnostic hints. 3.2.3.1 power up state when the 82598 powers up, it automatically reads the eeprom. the eeprom contains sufficient information to bring the link up and configure the 82598 for manageability and/or apm wake up. however, software initialization is required for normal operation. 3.2.3.2 initialization sequence the following sequence of commands is typically issued to the 82598 by the software device driver in order to initialize the 82598 for normal operation. the major initialization steps are: 1. disable interrupts. 2. issue a global reset and perform general configuration. 3. wait for the eeprom auto read to complete. 4. wait for a manageability configuration done indication (eemngctl.cfg_done). 5. wait for a dma init done (rdrxctl.dmaidone) 6. setup the phy and the link. 7. initialize all statistical counters. 8. initialize receive. 9. initialize transmit. 10. enable interrupts. 3.2.3.2.1 disabling interrupts during initialization most drivers disable interrupts during initialization to prevent re-entrancy. interrupts are disabled by writing to the eimc register. note that the interrupts need to also be disabled after issuing a global reset, so a typical driver initialization flow is: ? disable interrupts ? issue a global reset ? disable interrupts (again) after the initialization completes, a typical driver enables the desired interrupts by writing to the ims register. 3.2.3.2.2 global reset and general configuration device initialization typically starts with a software reset and link reset that puts the 82598 into a known state and enables the device driver to continue the initialization sequence. several values in the device control (ctrl) register (0x00000/0x00004, rw) need to be set upon power up or after an 82598 reset to normal operation.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 147 to enable flow control, program the mac address to ral and rah. other registers to be configured are fcttv, fcrtl, fcrth and fcrtv. if flow control is not enabled, the above registers should be written with 0b. the core configuration according to the electrical specification of the relevant electrical interface should be set prior to the link setup. this configuration is done through the eeprom by applying the appropriate settings to the core block. 3.2.3.2.3 link setup mechanisms and control/status bit summary 3.2.3.2.3.1 bx 1 gb/s link setup the 82598 pcs initialization is done using the following steps: 1. bx link electrical setup is done according to eeprom configuration to set the analog interface to the appropriate setting. 2. configure the 1g auto negotiation enable in the autoc register to make sure the link follows ieee802.3 clause 37 auto negotiation flow. 3. configure the speed configuration field to 1 gb link in the autoc register. 4. if necessary, configure any interface fields in the serdesc register. 5. configure the kx/kx4 auto negotiation enable field to disabled in the autoc register. this causes the speed control field to control the link. 6. restart the link using the restart auto negotiation field in the autoc register. 7. check the link status (sync, link_up, speed) using the links register. 3.2.3.2.3.2 10 gb/s link setup xaui / cx4 link setup 82598 xaui/ cx initialization is done using the following steps: 1. xaui / cx4 link electrical setup is done according to eeprom configuration to set the analog interface to the appropriate setting. 2. configure the speed configuration field to 10 gb/s link in the autoc register. 3. if necessary, configure any interface fields in the serdesc register. 4. configure the kx/kx4 auto negotiation enable field to disabled in the autoc register. this causes the speed control field to control the link. 5. restart the link using the restart auto negotiatio n field in the autoc register. 6. check the link status (align, link_up, speed) using the links register. kx / kx4 link setup 82598 kx/kx4 without auto negotiation initialization is done using the following steps: 1. kx/kx4 link electrical setup is done according to eeprom configuration to set the analog interface to the appropriate setting. 2. configure the speed configuration field to 10 gb/s or 1 gb/s link in the autoc register (for kx4/kx accordingly). 3. if necessary, configure any interface fields in the serdesc register. 4. configure the kx/kx4 auto negotiation enable field to disabled in the autoc register. this causes the speed control field to control the link. 5. restart the link using the restart auto negotiation field in the autoc register. 6. check the link status (sync, align, link_up, speed) using the links register.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 148 october 2010 the 82598 kx/kx4 with auto negotiation initialization is done using the following steps: 1. kx / kx4 link electrical setup is done according to eeprom configuration to set the analog interface to the appropriate setting. 2. if necessary, configure any interface fields in the serdesc register. 3. configure the kx/kx4 auto negotiation enable field to enabled in the autoc register. 4. configure the kx_support field and any other auto negotiation related fields in the autoc register. 5. restart the link using the restart auto negotiation field in the autoc register. 6. check the link status (sync, align, link_up, speed) using the links register. 3.2.3.2.4 initialization of statistics statistics registers are hardware-initialized to values as detailed in each particular register's description. the initialization of these registers begins upon transition to d0active power state (when internal registers become accessible, as enabled by setting the memory access enable field in the pcie command register). all of the statistical counters are cleared on read and a typical software device driver reads them (thus making them zero) as a part of the initialization sequence. 3.2.3.2.5 receive initialization program the receive address low ? ral (0x05400 + 8*n[n=0..15]; rw) and receive address high ? rah (0x05404 + 8*n[n=0..15]; rw) registers with adapter addresses. if an eeprom is present, ral0 and rah0 are loaded from it. set up the multicast table array ? mta (0x05200-0x053fc; rw) if reception of multicast packets is required. the entire table should be zeroed and only desired multicast addresses should be permitted (by writing 0x1 to corresponding bit location). the mfe bit should be set in order for multicast filtering to take effect. set up the vlan filter table array ? vfta (0x0a000-0x0a9fc; rw) if vlan support is required. the entire table should be zeroed and only desired vlan addresses should be permitted (by writing 0x1 to corresponding bit location). the vfe bit should be set in order for vlan filtering to take effect. working with legacy interrupts: program the interrupt mask register to pass any interrupt the software device driver cares about. there is no reason to enable the transmit interrupts. if software uses the receive descriptor minimum threshold interrupt, the rdmts field of rdrxctl register should be set. program the interrupt vector allocation table. working with msi-x: program the msi-x table. the following should be done once per receive queue: ? allocate a region of memory for the receive descriptor list. ? receive buffers of appropriate size should be allocated and pointers to these buffers should be stored in the descriptor ring. ? program the descriptor base address with the address of the region. ? set the length register to the size of the descriptor ring.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 149 ? program srrctl associated with this queue according to the size of the buffers and the required header control. ? if header split or header replication is required for this queue, the appropriate psrtype must be programmed for the appropriate headers as follows: ? program srrctl with appropriate values including the queue enable bit. ? set 0b into the tail pointer. ? poll the queue enable bit and make sure that the queue is enabled (read rxdctl.qx.25 and make sure it is set). ? disable the queue by writing to rxdctl.qx.25 = 0b (make sure the descriptor count in the dbu is cleared). ? poll the queue enable bit and make sure that the queue is disabled (read rxdctl.qx.25 and make sure it is cleared). ? enable the queue by writing to rxdctl.qx.25 = 1b. ? poll the queue enable bit and make sure that the queue is enabled (read rxdctl.qx.25 and make sure it is set). ? program rxdctl with appropriate values including the queue enable bit. ? program the tail pointer to enable the fetch of descriptors note: packets to a disabled queue are dropped. 3.2.3.2.6 dynamic enabling and disabling of receive queues receive queues can be enabled or disabled dynamically if the following procedure is followed. 1. enabling: a. follow the per queue initialization described in the previous section. 2. disabling: a. disable the direction of packets to this queue. b. disable the queue by clearing the enable bit in rxdctl. the 82598 stops fetching and writing back descriptors from this queue. any further packet that is directed to this queue is dropped. if a packet is being processed, the 82598 completes the current buffer write if the packet spreads over more than one buffer. all subsequent buffers are not written. c. the 82598 clears the rxdctl.enable bit only after all pending memory accesses to the descriptor ring are done. the software device driver should poll this bit and then wait an additional amount of time (> 100 ? s) before releasing the memory allocated to this queue. there might be additional packets in the receive packet buffer targeted to the disabled queue. the arbitration might be such that it would take a long time to drain down those packets. if software re- enables a queue before all packets to that queue were drained, the enabled queue might potentially get packets directed to the old configuration of the queue. for example, vm goes down and a different vm gets the queue (if there were undrained packets) these packets targeted to the previous vm would get to the new vm that owns the queue. the receive path can be disabled only after all the receive queues are disabled. 3.2.3.2.7 transmit initialization the following should be done once per transmit queue: ? allocate a region of memory for the transmit descriptor list. ? program the descriptor base address with the address of the region.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 150 october 2010 ? set the length register to the size of the descriptor ring. ? initialize the transmit descriptor registers (tdbal, tdbah, tdl). ? program the transmit descriptor control registers with the desired tx descriptor write back policy. suggested values are: ? wthresh = 1b ? all other fields 0b. ? enable queue using txdctl.enable ? poll the queue enable bit to make sure the queue is enabled (read txdctl.qx.25; check that it is set). 3.2.3.2.8 dynamic enabling and disabling of transmit queues transmit queues can be enabled or disabled dynamically if the following procedure is followed. 1. enabling: a. follow the per queue initialization described in the previous section. 2. disabling: a. stop storing packets for transmission in this queue. b. wait until the head of the queue tdh equals the tail tdt ? indicates the queue is empty. c. wait until all descriptors are written back (polling dd bit in ring or polling the head_wb content). it might be required to flush the transmit queue by setting the txdctl[n].swflsh if the rs bit in the last fetched descriptor is not set or if wthresh is greater than zero. d. disable the queue by clearing txdctl.enable. the transmit path can be disabled only after all transmit queue are disabled. 3.3 power management and delivery this section describes how power management is implemented in the 82598. 3.3.1 power delivery the 82598?s power is delivered through external voltage regulators. refer to section 8. for more details. 3.3.1.1 82598 power states the 82598 supports the d0 and d3 power states defined in the pci power management and pcie specifications. d0 is divided into two sub-states: d0u (d0 un-initialized) and d0a (d0 active). in addition, the 82598 supports a dr state that is entered when pe_rst_n is asserted (including the d3cold state). figure 3-13 shows the power states and transitions between them.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 151 figure 3-13. power management state diagram 3.3.1.2 auxiliary power usage if advd3wuc=1b, the 82598 uses the aux_pwr indication that auxiliary power is available to the 82598, and therefore advertises d3cold wake up support. the amount of power required for the function (which includes the entire nic) is advertised in the power management data register, which is loaded from the eeprom. if d3cold is supported, the pme_en and pme_status bits of the power management control/status register (pmcsr), as well as their shadow bits in the wake up control (wuc) register are reset only by the power up reset (detection of power rising). the only effect of setting aux_pwr to 1b is advertising d3cold wake up support and changing the reset function of pme_en and pme_status. aux_pwr is a strapping option in the 82598. the 82598 tracks the pme_en bit of the power management control/status register (pmcsr) and the auxiliary (aux) power pm enable bit of the pcie device control register to determine the power it might consume (and therefore its power state) in the d3cold state (internal dr state). note that the actual amount of power differs between form factors. the pcie_aux bit in the eeprom determines if the 82598 complies with the auxiliary power regime defined in the pcie specification. if set, the 82598 might consume higher aux power according to the following settings: ? if the auxiliary (aux) power pm enable bit of the pcie device control register is set, the 82598 might consume higher power for any purpose (even if pme_en is not set). ? if the auxiliary (aux) power pm enable bit of the pcie device control register is cleared, higher power consumption is determined by the pci-pm legacy pme_en bit of the power management control/status register (pmcsr). if the pcie_aux bit in the eeprom is cleared, the 82598 consumed aux power in dr state independent of the setting of either the pme_en bit or the auxiliary (aux) power pm enable bit.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 152 october 2010 3.3.1.3 interconnects power management this section describes the power reduction techniques used by the 82598?s main interconnects. 3.3.1.3.1 pcie link power management the pcie link state follows the power management state of the 82598. since the 82598 incorporates multiple pci functions, the device power management state is defined as the power management state of the most awake function: ? if any function is in d0 state (either d0a or d0u), the pcie link assumes the 82598 is in d0 state. else: ? if the functions are in d3 state, the pcie link assumes the 82598 is in d3 state. else: ? the device is in dr state (pe_rst_n is asserted to all functions). the 82598 supports all pcie power management link states other than l1 aspm: ? l0 state is used in d0u and d0a states. ? the l0s state is used in d0a and d0u states each time the link conditions apply. ? the l1 state is used in the d3 state. ? the l2 state is used in the dr state following a transition from a d3 state if pci-pm pme is enabled. ? the l3 state is used in the dr state following power up, on transition from d0a and also if pme is not enabled in other dr transitions. the 82598 support for active state link power management is reported via the pcie active state link pm support register loaded from eeprom.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 153 figure 3-14. link power management state diagram while in l0 state, the 82598 transitions the transmit lane(s) into l0s state once the idle conditions are met for a period of time defined below. l0s configuration fields are: ? l0s enable ? the default value of the active state link pm control field in the pcie link control register is set to 00b (both l0s and l1 disabled). system software might later write a different value into the link control register. the default value is loaded on any reset of the pci configuration registers. ? the l0s_entry_lat bit in the pcie control (gcr) register, determines l0s entry latency. when set to 0b, l0s entry latency is the same as l0s exit latency of the 82598 at the other end of the link. when set to 1b, l0s entry latency is (l0s exit latency of the 82598 at the other end of the link/4). the default value is 0b (entry latency is the same as l0s exit latency of the 82598 at the other end of the link). ? l0s exit latency (as published in the l0s exit latency field of the link capabilities register) is loaded from eeprom. separate values are loaded when the 82598 shares the same reference pcie clock with its partner across the link and when the 82598 uses a different reference clock than its partner across the link. the 82598 reports whether it uses the slot clock configuration through the pcie slot clock configuration bit loaded from the slot_clock_cfg eeprom bit. ? l0s acceptable latency (as published in the endpoint l0s acceptable latency field of the device capabilities register) is loaded from eeprom.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 154 october 2010 3.3.1.3.2 network interfaces power management the 82598 transitions any of the xaui interfaces into a low-power state in the following cases: ? the respective lan function is in lan disable mode using the lanx_dis_n pin. ? the 82598 is in dr state, apm wol is disabled for the port, acpi wake is disabled for the port and pass-through manageability is disabled for the port. use of the lan ports for pass-through manageability follows the following behavior: ? if manageability is disabled (as loaded from the eeprom), then lan ports are not allocated for manageability. ? if manageability is enabled: ? power-up ? following eeprom read, a single port is enabled for manageability, running at the lowest speed supported by the interface. if apm wol is enabled on a single port, the same port is used for manageability. otherwise, manageability protocols (teaming) determine which port is used. ? d0 state ? both lan ports are enabled for manageability. ? d3 and dr states ? a single port is enabled for manageability, running at the lowest speed supported by the interface. if wol is enabled on a single port, the same port is used for manageability. otherwise, manageability protocols (such as teaming) determine which port is used. enabling a port as a result of the above causes an internal reset of the port. when a xaui interface is in low-power state, the 82598 asserts the respective phy0_pwrdn_n or phy1_pwrdn_n pin to enable an external phy device to power down as well. 3.3.1.4 power states 3.3.1.4.1 d0 uninitialized state the d0u state is a low-power state used after pe_rst_n is de-asserted following power up (cold or warm), on hot reset (in-band reset through pcie physical layer message) or on d3 exit. when entering d0u, the 82598 disables wake ups. if the apm mode bit in the eeprom's control word 3 is set, then apm wake up is enabled. 3.3.1.4.1.1 entry into d0u state d0u is reached from either the dr state (on de-assertion of internal pe_rst_n) or the d3hot state (by configuration software writing a value of 00b to the power state field of the pci pm registers). de-asserting the internal pe_rst_n means that the entire state of the 82598 is cleared, other than sticky bits. state is loaded from the eeprom, followed by establishment of the pcie link. once this is done, configuration software can access the 82598. on a transition from d3 to d0u state, the 82598 requires that software perform a full re-initialization of the function including its pci configuration space. 3.3.1.4.2 d0active state once memory space is enabled, the 82598 enters an active state. it can transmit and receive packets if properly configured by the driver. any apm wakeup previously active remains active. the driver can deactivate apm wakeup by writing to the wake up control (wuc) register, or activate other wake up filters by writing to the wake up filter control (wufc) register.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 155 3.3.1.4.2.1 entry to d0a state d0a is entered from the d0u state by writing a 1b to the memory access enable or the i/o access enable bit of the pci command register. the dma, mac, and phy of the appropriate lan function are enabled. 3.3.1.4.3 d3 state (pci-pm d3hot) the 82598 transitions to d3 when the system writes a 11b to the power state field of the power management control/status register (pmcsr). any wake-up filter settings that were enabled before entering this reset state are maintained. upon transitioning to d3 state, the 82598 clears the memory access enable and i/o access enable bits of the pci command register, which disables memory access decode. in d3, the 82598 only responds to pci configuration accesses and does not generate master cycles. configuration and message requests are the only pcie tlps accepted by a function in the d3hot state. all other received requests must be handled as unsupported requests, and all received completions can optionally be handled as unexpected completions. if an error caused by a received tlp (an unsupported request) is detected while in d3hot, and reporting is enabled, the link must be returned to l0 if it is not already in l0 and an error message must be sent. see section 5.3.1.4.1 in the pcie v2.0 (2.5 gt/s) specification. a d3 state is followed by either a d0u state (in preparation for a d0a state) or by a transition to dr state (pci-pm d3cold state). to transition back to d0u, the system writes a 00b to the power state field of the power management control/status register (pmcsr). transition to dr state is through pe_rst_n assertion. 3.3.1.4.3.1 entry to d3 state transition to d3 state is through a configuration write to the power state field of the pci-pm registers. prior to transition from d0 to the d3 state, the software device driver disables scheduling of further tasks to the 82598; it masks all interrupts, it does not write to the transmit descriptor tail register or to the receive descriptor tail register and operates the master disable algorithm as defined in section 3.3.1.4.3.2 . if wake-up capability is needed, the software device driver should set up the appropriate wake-up registers and the system should write a 1b to the pme_en bit of the power management control/status register (pmcsr) or to the auxiliary (aux) power pm enable bit of the pcie device control register prior to the transition to d3. if all pci functions are programmed into d3 state, the 82598 brings its pcie link into the l1 link state. as part of the transition into l1 state, the 82598 suspends scheduling of new tlps and waits for the completion of all previous tlps it has sent. the 82598 clears the memory access enable and i/o access enable bits of the pci command register, which disables memory access decode. any receive packets that have not been transferred into system memory is kept in the 82598 (and discarded later on d3 exit). any transmit packets that have not be sent can still be transmitted (assuming the ethernet link is up). in preparation to a possible transition to d3cold state, the software device driver can disable one of the lan ports (lan disable) and/or transition the link(s) to gb speed (if supported by the network interface). see section 3.3.1.3.2 for a description of network interface behavior in this case. 3.3.1.4.3.2 master disable system software can disable master accesses on the pcie link by either clearing the pci bus master bit or by bringing the function into a d3 state. from that time on, the 82598 must not issue master accesses for this function. due to the full-duplex nature of pcie, and the pipelined design in the 82598, it might happen that multiple requests from several functions are pending when the master disable request arrives. the protocol described in this section insures that a function does not issue master requests to the pcie link after its master enable bit is cleared (or after entry to d3 state).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 156 october 2010 two configuration bits are provided for the handshake between the device function and its software device driver: ? gio master disable bit in the device control (ctrl) register ? when the gio master disable bit is set, the 82598 blocks new master requests by this function. the 82598 then proceeds to issue any pending requests by this function. this bit is cleared on master reset (internal power on reset all the way to software reset) to enable master accesses. ? gio master enable status bits in the device status register ? cleared by the 82598 when the gio master disable bit is set and no master requests are pending by the relevant function. set otherwise. indicates that no master requests are issued by this function as long as the gio master disable bit is set. the following activities must end before the 82598 clears the gio master enable status bit: ? master requests by the transmit and receive engines ? all pending completions to the 82598 are received. notes: ? the software device driver sets the gio master disable bit when notified of a pending master disable (or d3 entry). the 82598 then blocks new requests and proceeds to issue any pending requests by this function. the software device driver then polls the gio master enable status bit. once the bit is cleared, it is guaranteed that no requests are pending from this function. the software device driver might time out if the gio master enable status bit is not cleared within a given time. ? the gio master disable bit must be cleared to enable master request to the pcie link. can be done either through reset or by the software device driver. 3.3.1.4.4 dr state transition to dr state is initiated on several occasions: ? on system power up ? dr state begins with the assertion of internal power on reset or lan_pwr_good and ends with de-assertion of pe_rst_n. ? on transition from a d0a state ? during operation, the system might assert pe_rst_n at any time. in an acpi system, a system transition to the g2/s5 state causes a transition from d0a to dr state. ? on transition from a d3 state ? the system transitions the 82598 into the dr state by asserting pcie pe_rst_n. any wake-up filter settings that were enabled before entering this reset state are maintained. the system might maintain pe_rst_n asserted for an arbitrary time. the de-assertion (rising edge) of pe_rst_n causes a transition to d0u state. while in dr state, the 82598 might maintain functionality (for wol or manageability) or might enter a dr disable state (if no wol and no manageability) for minimal 82598 power. 3.3.1.4.4.1 dr disable mode the 82598 enters a dr disable mode on transition to d3cold state when it does not need to maintain any functionality. the conditions to enter either state are: ? the 82598 (all pci functions) is in dr state ? apm wol is inactive for both lan functions ? pass-through manageability is disabled
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 157 ? acpi pme is disabled for all pci functions entry into dr disable is done on assertion of pcie pe_rst_n. it might also be possible to enter dr disable mode by reading the eeprom while already in dr state. the usage model for this later case is on system power up, assuming that manageability and wake up are not required. once the 82598 enters dr state on power-up, the eeprom is read. if the eeprom contents determine that the conditions to enter dr disable are met, the 82598 then enters this mode (assuming that pcie pe_rst_n is still asserted). exit from dr disable is through de-assertion of pcie pe_rst_n. if dr disable mode is entered from d3 state, the 82598 asserts the dev_pwrdn_n output signal to indicate to the platform that it might remove power from the 82598. the platform must remove all power rails from the 82598 if it needs to use this capability. exiting from this state is through power-up reset to the 82598. note that the state of the dev_pwrdn_n and the phyx_pwrdn_n outputs is undefined once power is removed from the 82598. 3.3.1.4.4.2 entry to dr state dr entry on platform power-up is as follows: ? asserting internal power on reset or lan_pwr_good. the 82598 power is kept to a minimum by keeping the xaui interfaces in low power. ? the eeprom is then read and determines the 82598 configuration. ? if the apm enable bit in the eeprom's initialization control word 2 is set then apm wake up is enabled (for each port independently). ? if the mng enable bit in the eeprom is set, pass-through manageability is not enabled. ? each of the lan ports can be enabled, if required, for wol or manageability. see section 3.3.1.3.2 for exact condition to enable a port. ? the pcie link is not enabled in dr state following system power up (since pe_rst_n is asserted). entry to dr state from d0a state is through assertion of the pe_rst_n signal. an acpi transition to the g2/s5 state is reflected in an 82598 transition from d0a to dr state. the transition might be orderly (programmer selected a show down operating system option), in which case the software device driver might have a chance to intervene. or, it might be an emergency transition (power button override), in which case, the software device driver is not notified. transition from d3 state to dr state is done by assertion of pe_rst_n signal. prior to that, the system initiates a transition of the pcie link from l1 state to either the l2 or l3 state (assuming all functions were already in d3 state). the link enters l2 state if pci-pm pme is enabled. 3.3.1.5 timing of power-state transitions the following sections give detailed timing for the state transitions. in the diagrams the dotted connecting lines represent the 82598 requirements, while the solid connecting lines represent the 82598 guarantees. the timing diagrams are not to scale. the clocks edges are shown only to indicate running clocks are not used to indicate the actual number of cycles for any operation.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 158 october 2010 3.3.1.5.1 transition from d0a to d3 and back without pe_rst_n figure 3-15. d0a to d3 and back without pe_rst_n
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 159 table 3-40. d0a to d3 and back without pe_rst_n 3.3.1.5.2 transition from d0a to d3 and back with pe_rst_n figure 3-16. d0a to d3 and back with pe_rst_n note description 1 writing 11b to the power state field of the power management control/status register (pmcsr) transitions the 82598 to d3. 2 the system can keep the 82598 in d3 state for an arbitrary amount of time. 3 to exit d3 state the system writes 00b to the power state field of the power management control/status register (pmcsr). 4 apm wake up or manageability can be enabled based on what is read in the eeprom. 5 after reading the eeprom, the lan ports are enabled and the 82598 transitions to d0u state. 6 the system can delay an arbitrary time before enabling memory access. 7 writing a 1b to the memory access enable bit or to the i/o access enable bit in the pci command register transitions the 82598 from d0u to d0 state.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 160 october 2010 table 3-41. d0a to d3 and back with pe_rst_n note 1 writing 11b to the power state field of the power management control/status register (pmcsr) transitions the 82598 to d3. pcie link transitions to l1 state. 2 the system can delay an arbitrary amount of time between setting d3 mode and transitioning the link to an l2 or l3 state. 3 following link transition, pe_rst_n is asserted. 4 the system must assert pe_rst_n before stopping the pcie reference clock. it must also wait t l2clk after link transition to l2/l3 before stopping the reference clock. 5 on assertion of pe_rst_n, the 82598 transitions to dr state. 6 the system starts the pcie reference clock t pwrgd-clk before de-assertion pe_rst_n. 7 the internal pcie clock is valid and stable t ppg-clkint from pe_rst_n de-assertion. 8 the pcie internal pwrgd signal is asserted tclkpr after the external pe_rst_n signal 9 assertion of internal pcie pwrgd causes the eeprom to be re-readand disables wake up. 10 apm wake up mode can be enabled based on what is read from the eeprom. 11 link training starts after t pgtrn from pe_rst_n de-assertion. 12 a first pcie configuration access can arrive after t pgcfg from pe_rst_n de-assertion. 13 a first pci configuration response can be sent after t pgres from pe_rst_n de-assertion 14 writing a 1b to the memory access enable bit in the pci command register transitions the 82598 from d0u to d0 state.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 161 3.3.1.5.3 transition from d0a to dr and back without transition to d3 figure 3-17. d0a to dr and back without transition to d3 table 3-42. d0a to dr and back without transition to d3 3.3.1.5.4 timing requirements the 82598 requires the following start-up and power-state transitions. note description 1 the system must assert pe_rst_n before stopping the pcie reference clock. it must also wait t l2clk after link transition to l2/l3 before stopping the reference clock. 2 on assertion of pe_rst_n, the 82598 transitions to dr state and the pcie link transition to electrical idle. 3 the system starts the pcie reference clock t pwrgd-clk before de-assertion pe_rst_n. 4 the internal pcie clock is valid and stable t ppg-clkint from pe_rst_n de-assertion. 5 the pcie internal pwrgd signal is asserted t clkpr after the external pe_rst_n signal. 6 assertion of internal pcie pwrgd causes the eeprom to be re-read and disables wake up. 7 apm wake up mode can be enabled based on what is read from the eeprom. 9 link training starts after t pgtrn from pe_rst_n de-assertion. 10 a first pcie configuration access might arrive after t pgcfg from pe_rst_n de-assertion. 11 a first pci configuration response can be sent after t pgres from pe_rst_n de-assertion. 12 writing a 1b to the memory access enable bit in the pci command register transitions the 82598 from d0u to d0 state.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 162 october 2010 table 3-43. start-up and power-state transitions 3.3.1.5.5 timing guarantees the 82598 guarantees the following start-up and power-state transition related timing parameters. parameter description min max. notes t xog xosc stable from power stable 10 ms t pwrgd-clk pcie clock valid to pcie power good 100 ? s - according to pcie specification. t pvpgl power rails stable to pcie pwrgd active 100 ms - according to pcie specification. t pgcfg external pwrgd signal to first configuration cycle. 100 ms according to pcie specification. t d0mem device programmed from d3h to d0 state to next device access 10 ms according to pci power management specification. t l2pg l2 link transition to pwrgd de-assertion 0 ns according to pcie specification. t l2clk l2 link transition to removal of pcie reference clock 100 ns according to pcie specification. parameter description min max. notes c lkpg pwrgd de-assertion to removal of pcie reference clock 0 ns according to pcie specification. t pgdl pwrgd de-assertion time 100 ? s according to pcie specification.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 163 table 3-44. start-up and power-state transition related timing parameters 3.3.2 wake up 3.3.2.1 advanced power management wake up advanced power management wake up, or apm wake up, was previously known as wake on lan (wol). it is a feature that has existed in the 10/100 mb/s nics for several generations. the basic premise is to receive a broadcast or unicast packet with an explicit data pattern, and then to assert a signal to wake up the system. in the earlier generations, this was accomplished by using a special signal that ran across a cable to a defined connector on the motherboard. the nic asserts the signal for approximately 50 ms to signal a wake up. the 82598 uses (if configured to) an in-band pm_pme message for this. at power-up, the 82598 reads the apm enable bit from the eeprom into the apm enable (apme) bits of the grc register this bit controls the enabling of apm wake up. when apm wakeup is enabled, the 82598 checks all incoming packets for magic packets*. refer to section 3.3.2.3.1.4 for more information. once the 82598 receives a matching magic packet, it: ? sets the pme_status bit in the power management control/status register (pmcsr) and issues a pm_pme message (in some cases, this might be required to assert the wake# signal first to resume power and clock to the pcie interface). ? stores the first 128 bytes of the packet in wupm. ? sets the magic packet received bit in the wus register. ? sets the packet length in the wupl register. the 82598 maintains the first magic packet received in wupm until the software device driver writes a 0b to the magic packet received mag bit in the wus register. apm wake up is supported in all power states and only disabled if a subsequent eeprom read results in the apm wake up bit being cleared or the software explicitly writes a 0b to the apm wake up (apm) bit of the grc register. parameter description min max. notes t xog xosc stable from power stable 10 ms t ppg internal power good delay from valid power rail 35 ms 35 ms t ee eeprom read duration 20 ms t ppg-clkint pcie pwrgd to internal pll lock - 50 ? s t clkpr internal pcie pwgd from external pcie pwrgd 50 ? s t pgtrn pcie pwrgd to start of link training 20 ms according to pcie specification. t pgres external pwrgd to response to first configuration cycle 1 s according to pcie specification.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 164 october 2010 3.3.2.2 acpi power management wakeup the 82598 supports acpi power management based wake ups. it can generate system wake-up events from three sources: ? reception of a magic packet*. ? reception of a network wake-up packet. ? detection of a link change of state. activating acpi power management wake up requires the following steps: ? the operating system (at configuration time) writes a 1b to the pme_en bit (bit 8) of the pmcsr register. ? the software device driver clears all pending wake-up status in the wus register by writing 1b to all the status bits. ? the software device driver programs the wake up filter control (wufc) register to indicate the packets it needs to wake up and supplies the necessary data to the ipv4/v6 address table (ip4at, ip6at), flexible host filter table (fhft). it can also set the link status change wake up enable (lnkc) bit in the wufc register to cause a wake up when the link changes state. ? once the 82598 wakes up the system the driver needs to clear wus and wufc until the next time the system goes to a low power state with wake up. normally, after enabling wake up, the operating system writes (11b) to the lower two bits of the pmcsr to put the 82598 into low-power mode. once wake up is enabled, the 82598 monitors incoming packets, first filtering them according to its standard address filtering method, then filtering them with all of the enabled wakeup filters. if a packet passes both the standard address filtering and at least one of the enabled wake-up filters, the 82598: ? sets the pme_status bit in the pmcsr. ? if the pme_en bit in the pmcsr is set, asserts pe_wake_n. ? stores the first 128 bytes of the packet in wupm. ? sets one or more of the received bits in the wus register (the 82598 sets more than one bit if a packet matches more than one filter). ? sets the packet length in the wupl register. if enabled, a link state change wakeup causes similar results, setting pme_status , asserting pe_wake_n and setting the link status changed (lnkc) bit in the wus register when the link goes up or down. pe_wake_n remains asserted until the operating system either writes a 1b to the pme_status bit of the pmcsr register or writes a 0b to the pme_en bit. after receiving a wakeup packet, the 82598 ignores any subsequent wake-up packets until the software device driver clears all of the received bits in the wake up status (wus) register. it also ignores link change events until the software device driver clears the link status changed (lnkc) bit in the wake up status (wus) register. 3.3.2.3 wake-up packets the 82598 supports various wake-up packets using two types of filters: ? pre-defined filters
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 165 ? flexible filters each of these filters are enabled if the corresponding bit in the wufc register is set to 1b. when vlan filtering is enabled, a packet that passed any of the receive wake-up filters should only cause a wake-up event if it also passed vlan filtering. this is true for all wake-up packets except for directed packets (including exact, multicast indexed, and broadcast) and magic packets, which are not broadcaster. 3.3.2.3.1 pre-defined filters the following packets are supported by the 82598's pre-defined filters: ? directed packet (including exact, multicast indexed, and broadcast) ? magic packet* ? arp/ipv4 request packet ? directed ipv4 packet ? directed ipv6 packet each of these filters are enabled if the corresponding bit in the wufc register is set to 1b. the explanation of each filter includes a table showing which bytes at which offsets are compared to determine if the packet passes the filter. both vlan frames and llc/snap can increase the given offsets if they are present. 3.3.2.3.1.1 directed exact packet the 82598 generates a wake-up event after receiving any packet whose destination address matches one of the 16 valid programmed receive addresses if the directed exact wake up enable bit is set in the wake up filter control (wufc.ex) register. 3.3.2.3.1.2 directed multicast packet for multicast packets, the upper bits of the incoming packet's destination address index a bit vector, the multicast table array that indicates whether to accept the packet. if the directed multicast wake up enable bit set in the wake up filter control (wufc.mc) register and the indexed bit in the vector is 1b then the 82598 generates a wake-up event. the exact bits used in the comparison are programmed by software in the multicast offset field of the multicast control (mcstctrl.mo) register. 3.3.2.3.1.3 broadcast if the broadcast wake up enable bit in the wake up filter control (wufc.bc) register is set, the 82598 generates a wake-up event when it receives a broadcast packet. offset # of bytes field value action comment 0 6 destination address compare match any pre-programmed address offset # of bytes field value action comment 0 6 destination address compare see 3.3.2.3.1.2
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 166 october 2010 3.3.2.3.1.4 magic packet* magic packets are defined in: http://www.amd.com/products/npd/overview/20212.html as: magic packet technology details once the lan controller has been put into the magic packet mode, it scans all incoming frames addressed to the node for a specific data sequence, which indicates to the controller that this is a magic packet frame. a magic packet frame must also meet the basic requirements for the lan technology chosen, such as source address, destination address (which may be the receiving station's ieee address or a multicast address which includes the broadcast address), and crc. the specific data sequence consists of 16 duplications of the ieee address of this node, with no breaks or interruptions. this sequence can be located anywhere within the packet, but must be preceded by a synchronization stream. the synchronization stream allows the scanning state machine to be much simpler. the synchronization stream is defined as 6 bytes of ffh. the device also accepts a broadcast frame, as long as the 16 duplications of the ieee address match the address of the machine to be awakened. the 82598 expects the destination address to: 1. be the broadcast address (0xff.ff.ff.ff.ff.ff) 2. match the value in receive address register 0 (rah0, ral0). this is initially loaded from the eeprom but might be changed by the software device driver. 3. match any other address filtering enabled by the software device driver. the 82598 searches for the contents of receive address register 0 (rah0, ral0) as the embedded ieee address (it catches the case of seven 0xffs followed by the ieee address). as soon as one of the first 96 bytes after a string of 0xffs doesn't match, it continues to search for anther set of at least six 0xffs followed by the 16 copies of the ieee address later in the packet. a magic packet's destination address must match the address filtering enabled in the configuration registers with the exception that broadcast packets are considered to match even if the broadcast accept bit of the receive control register (fctrl.bam) is 0b. if apm wakeup is enabled in the eeprom, the 82598 starts up with the receive address register 0 (rah0, ral0) loaded from the eeprom. this enables the 82598 to accept packets with the matching ieee address before the software device driver comes up. offset # of bytes field value action comment 0 6 destination address 0xff*6 compare offset # of bytes field value action comment 0 6 destination address compare mac header ? processed by main address filter 6 6 source address skip 12 8 possible llc/snap header skip 12 4 possible vlan tag skip
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 167 3.3.2.3.1.5 arp/ipv4 request packet the 82598 supports receiving arp request packets for wakeup if the arp bit is set in the wake up filter control wufc) register. four ipv4 addresses are supported and are programmed in the ipv4 address table (ip4at). a successfully matched packet must pass l2 address filtering, a protocol type of 0x0806, an arp opcode of 0x01, and one of the four programmed ipv4 addresses. the 82598 also handles arp request packets that have vlan tagging on both ethernet ii and ethernet snap types. 12 4 type skip any 6 synchronizing stream 0xff*6+ compare any+6 96 16 copies of node address 0xa*16 compare compared to receive address register 0 (rah0, ral0) offset # of bytes field value action comment 0 6 destination address compare mac header ? processed by main address filter 6 6 source address skip 12 8 possible llc/snap header skip 12 4 possible vlan tag compare 12 2 type 0x0806 compare arp 14 2 hardware type 0x0001 compare 16 2 protocol type 0x0800 compare 18 1 hardware size 0x06 compare 19 1 protocol address length 0x04 compare 20 2 operation 0x0001 compare 22 6 sender hardware address - ignore 28 4 sender ip address - ignore offset # of bytes field value action comment 32 6 target hardware address - ignore 38 4 target ip address ip4at compare might match any of four values in ip4at
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 168 october 2010 3.3.2.3.1.6 directed ipv4 packet the 82598 supports receiving directed ipv4 packets for wakeup if the ipv4 bit is set in the wufc register. four ipv4 addresses are supported and are programmed in the ipv4 address table (ip4at). a successfully matched packet must pass l2 address filtering, a protocol type of 0x0800, and one of the four programmed ipv4 addresses. the 82598 also handles directed ipv4 packets that have vlan tagging on both ethernet ii and ethernet snap types. 3.3.2.3.1.7 directed ipv6 packet the 82598 supports receiving directed ipv6 packets for wakeup if the ipv6 bit is set in the wake up filter control (wufc) register. one ipv6 address is supported is programmed in the ipv6 address table (ip6at). a successfully matched packet must pass l2 address filtering, a protocol type of 0x08dd, and the programmed ipv6 address. the 82598 also handles directed ippv6 packets that have vlan tagging on both ethernet ii and ethernet snap types. offset # of bytes field value action comment 0 6 destination address compare mac header ? processed by main address filter 6 6 source address skip 12 8 possible llc/snap header skip 12 4 possible vlan tag compare 12 2 type 0x0800 compare ip 14 1 version/ hdr length 0x4x compare check ipv4 15 1 type of service - ignore 16 2 packet length - ignore 18 2 identification - ignore 20 2 fragment info - ignore 22 1 time to live - ignore 23 1 protocol - ignore 24 2 header checksum - ignore 26 4 source ip address - ignore 30 4 destination ip address ip4at compare may match any of 4 values in ip4at offset # of bytes field value action comment 0 6 destination address compare mac header ? processed by main address filter 6 6 source address skip
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 169 3.3.2.3.2 flexible filter the 82598 supports a total of four host flexible filters. each filter is can be configured to recognize any arbitrary pattern within the first 128 byte of the packet. to configure the flexible filter, the software programs the required values into the flexible host filter table (fhft). these contain separate values for each filter. the software must also enable the filter in the wufc register, and enable the overall wake up functionality must be enabled by setting pme_en in the pmcsr or the wuc register. once enabled, the flexible filters scan incoming packets for a match. if the filter encounters any byte in the packet where the mask bit is one and the byte doesn't match the byte programmed in the flexible host filter table (fhft) then the filter fails that packet. if the filter reaches the required length without failing the packet, it passes the packet and generates a wake-up event. it ignores any mask bits set to 1b beyond the required length. packets that passed the wake-up flexible filter should cause a wake-up event only if it is directed to the 82598 (passed l2 and vlan filtering). the flex filters are temporarily disabled when read from or written to by the host. any packet received during a read or write operation is dropped. filter operation resumes once the read or write access is done. the following packets are listed for reference purposes only. the flexible filter can be used to filter these packets. 3.3.2.3.2.1 ipx diagnostic responder request packet an ipx diagnostic responder request packet must contain a valid mac address, a protocol type of 0x8137, and an ipx diagnostic socket of 0x0456. it can also include llc/snap headers and vlan tags. since filtering this packet relies on the flexible filters, which use offsets specified by the operating system directly, the operating system must account for the extra offset llc/snap headers and vlan tags. 12 8 possible llc/snap header skip 12 4 possible vlan tag compare 12 2 type 0x08dd compare ip 14 1 version/ priority 0x6x compare check ipv6 15 3 flow label - ignore 18 2 payload length - ignore 20 1 next header - ignore 21 1 hop limit - ignore 22 16 source ip address - ignore 38 16 destination ip address ip6at compare match value in ip6at offset # of bytes field value action comment 0 6 destination address compare
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 170 october 2010 3.3.2.3.2.2 directed ipx packet a valid directed ipx packet contains the station's mac address, a protocol type of 0x8137, and an ipx node address that equals to the station's mac address. it can also include llc/snap headers and vlan tags. since filtering this packet relies on the flexible filters, which use offsets specified by the operating system directly, the operating system must account for the extra offset llc/snap headers and vlan tags. 3.3.2.3.2.3 ipv6 neighbor discovery filter in ipv6, a neighbor discovery packet is used for address resolution. a flexible filter can be used to check for a neighbor discovery packet. 3.3.2.3.3 wake-up packet storage the 82598 saves the first 128-byte of the wake-up packet in its internal buffer, which can be read through the wupm register after the system wakes up. 6 6 source address skip 12 8 possible llc/snap header skip 12 4 possible vlan tag compare 12 2 type 0x8137 compare ipx 14 16 some ipx stuff - ignore 30 2 ipx diagnostic socket 0x0456 compare offset # of bytes field value action comment 0 6 destination address compare mac header ? processed by main address filter 6 6 source address skip 12 8 possible llc/snap header skip 12 4 possible vlan tag compare 12 2 type 0x8137 compare ipx 14 10 some ipx stuff - ignore 24 6 ipx node address receive address 0 compare must match receive address 0
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 171 3.4 nvm map (eeprom) 3.4.1 eeprom general map table 3-45 lists the eeprom map used with 82598: table 3-45. eeprom map word used by high byte low byte 0x00 hw eeprom control word 1 0x01 hw eeprom control word 2 0x02 hw hardware reserved 0x03 hw pcie analog pointer 0x04 hw core 0 configuration pointer 0x05 hw core 1 configuration pointer 0x06 hw pcie general pointer 0x07 hw pcie configuration 0 pointer 0x08 hw pcie configuration 1 pointer 0x09 hw core 0 section pointer 0x0a hw core 1 section pointer 0x0b hw mac 0 section pointer 0x0c hw mac 1 section pointer 0x0d hw reserved 0x0e hw reserved 0x0f fw firmware section pointer 0x10 ? 0x14 sw compatibility high compatibility low 0x15 sw pba, byte 1 pba, byte 2 0x16 sw pba, byte 3 pba, byte 4 0x17 sw iscsi boot configuration start address 0x18 ? 0x2e software reserved word used by high byte low byte 0x2f sw vpd pointer 0x30 pxe pxe word 0 (software use) configuration
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 172 october 2010 table 3-45 lists the common sections for the entire eeprom: hardware pointers, software and firmware. the hardware sections (pointed to by words 0x03 ? 0x0c) are described following the common sections. 3.4.2 eeprom software section 3.4.2.1 compatibility fields ? words 0x10-0x14 five words in the eeprom image are reserved for compatibility information. new bits within these fields are defined as the need arises for determining software compatibility between various hardware revisions. 3.4.2.2 pba number module ? words 0x15:0x16 the nine-digit printed board assembly (pba) number used for intel manufactured network interface cards (nics) is stored in eeprom. through the course of hardware ecos, the suffix field is incremented. the purpose of this information is to enable customer support (or any user) to identify the revision level of a product. network driver software should not rely on this field to identify the product or its capabilities. pba numbers have exceeded the length that can be stored as hex values in two words. for newer nics, the high word in the pba number module is a flag (0xfafa) indicating that the actual pba is stored in a separate pba block. the low word is a pointer to the starting word of the pba block. the following shows the format of the pba number module field for new products. 0x31 pxe pxe word 1 (software use) configuration 0x32 pxe pxe word (software use) pxe version 0x33 pxe pxe word (software use) efi version 0x34 ? 0x37 pxe pxe words 0x38 hw eeprom control word 3 0x39 ? 0x3e hw hardware reserved 0x3f sw software checksum, words 0x00 ? 0x3f including the areas covered by the different hardware pointers. pba number word 0x8 word 0x9 g23456-003 fafa pointer to pba block table 3-45. eeprom map
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 173 the following provides the format of the pba block; pointed to by word 0x9 above: the new pba block contains the complete pba number and includes the dash and the first digit of the 3- digit suffix which were not included previously. each digit is represented by its hexadecimal-ascii values. the following shows an example pba number (in the new style): older nics have pba numbers starting with [a,b,c,d,e] and are stored directly in words 0x8-0x9. the dash in the pba number is not stored; nor is the first digit of the 3-digit suffix (the first digit is always 0b for older products). the following example shows a pba number stored in the pba number module field (in the old style): word offset description 0x0 length in words of the pba block (default is 0x6) 0x1 ... 0x5 pba number stored in hexadecimal ascii values. pba number word offset 0 word offset 1 word offset 2 word offset 3 word offset 4 word offset 5 g23456-003 0006 4732 3334 3536 2d30 3033 specifies 6 words g2 34 56 -0 03 pba number byte 1 byte 2 byte 3 byte 4 e23456-003 e2 34 56 03
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 174 october 2010 3.4.2.3 software eegen work area 3.4.2.3.1 ds_version ? word 0x29 3.4.2.3.2 oem version and id ? word 0x2a optional identifiers that allow a user to write a version and oem identifier in the eeprom image. 3.4.2.3.3 software init section pointer ? word 0x2 3.4.2.3.4 etrack_id ? word 0x2d:2e vpd pointer ? word 0x2f bits name default description 15:00 ds_version 0 dev_starter version used as a basis for the eeprom image. bits name default description 15:12 oem _version, minor # 0 minor # written to the middle 8 bits or word 0x08 11:4 oem _version, major # 0 major # written to the top 4 bits of word 0x08. 3:0 oem id 0 bits name default description 15:00 sis_pointer software init section pointer. 2d 2e name description bits bits etrack_id 32-bit sql-generated number written when an image is created by eegen on the intel lan. 15:00 15:00 bits name default description 15:00 vpd_pointer pointer to vital product data. set by eegen during compile.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 175 3.4.2.4 pxe configuration words ? word 0x30:3b pxe configuration is controlled by the following ewords. 3.4.2.4.1 setup options pci function 0 ? word 0x30 the main setup options are stored in word 30h. these options are those that can be changed by the user via the control-s setup menu. word 30h has the following format: bit(s) name function 15:13 rfu reserved. must be 0. 12:10 fsd bits 12-10 control forcing speed and duplex during driver operation. valid values are: 000b ? auto-negotiate 001b ? 10mbps half duplex 010b ? 100mbps half duplex 011b ? not valid (treated as 000b) 100b ? 10mbps full duplex 101b ? 100mbps full duplex 111b ? 1000mbps full duplex default value is 000b. 9 rsv reserved. set to 0. 8 dsm display setup message. if the bit is set to 1, the ?press control-s? message is displayed after the title message. default value is 1. 7-:6 pt prompt time. these bits control how long the ctrl-s setup prompt message is displayed, if enabled by dim. 00 = 2 seconds (default) 01 = 3 seconds 10 = 5 seconds 11 = 0 seconds note: ctrl-s message is not displayed if 0 seconds prompt time is selected. 5 dep deprecated. must be 0. 4:3 dbs default boot selection. these bits select which device is the default boot device. these bits are only used if the agent detects that the bios does not support boot order selection or if the mode field of word 31h is set to mode_legacy. 00 = network boot, then local boot (default) 01 = local boot, then network boot 10 = network boot only 11 = local boot only 2 dep deprecated. must be 0. 1:0 ps protocol select. these bits select the active boot protocol. 00 = pxe (default value) 01 = rpl (only if rpl is in the flash) 10 = iscsi boot primary port (only if iscsi boot is using this adapter) 11 = iscsi boot secondary port (only if iscsi boot is using this adapter) only the default value of 00b should be initially programmed into the adapter; other values should only be set by configuration utilities.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 176 october 2010 3.4.2.4.2 configuration customization options pci function 0 ? word 0x31 word 31h of the eeprom contains settings that can be programmed by an oem or network administrator to customize the operation of the software. these settings cannot be changed from within the control-s setup menu. the lower byte contains settings that would typically be configured by a network administrator using an external utility; these settings generally control which setup menu options are changeable. the upper byte is generally settings that would be used by an oem to control the operation of the agent in a lom environment, although there is nothing in the agent to prevent their use on a nic implementation. the default value for this word is 4000h. bit(s) name function 15:14 sig signature. must be set to 01 to indicate that this word has been programmed by the agent or other configuration software. 13 rfu reserved. must be 0. 12 rfu reserved. must be 0. 11 retry selects continuous retry operation. if this bit is set, iba will not transfer control back to the bios if it fails to boot due to a network error (such as failure to receive dhcp replies). instead, it will restart the pxe boot process again. if this bit is set, the only way to cancel pxe boot is for the user to press esc on the keyboard. retry will not be attempted due to hardware conditions such as an invalid eeprom checksum or failing to establish link. default value is 0. 10:8 mode selects the agent?s boot order setup mode. this field changes the agent?s default behavior in order to make it compatible with systems that do not completely support the bbs and pnp expansion rom standards. valid values and their meanings are: 000b normal behavior. the agent will attempt to detect bbs and pnp expansion rom support as it normally does. 001b force legacy mode. the agent will not attempt to detect bbs or pnp expansion rom supports in the bios and will assume the bios is not compliant. the user can change the bios boot order in the setup menu. 010b force bbs mode. the agent will assume the bios is bbs-compliant, even though it may not be detected as such by the agent?s detection code. the user can not change the bios boot order in the setup menu. 011b force pnp int18 mode. the agent will assume the bios allows boot order setup for pnp expansion roms and will hook interrupt 18h (to inform the bios that the agent is a bootable device) in addition to registering as a bbs ipl device. the user can not change the bios boot order in the setup menu. 100b force pnp int19 mode. the agent will assume the bios allows boot order setup for pnp expansion roms and will hook interrupt 19h (to inform the bios that the agent is a bootable device) in addition to registering as a bbs ipl device. the user can not change the bios boot order in the setup menu. 101b reserved for future use. if specified, is treated as a value of 000b. 110b reserved for future use. if specified, is treated as a value of 000b. 111b reserved for future use. if specified, is treated as a value of 000b. 7 rfu reserved. must be 0. 6 rfu reserved. must be 0. 5 dfu disable flash update. if this bit is set to 1, the user is not allowed to update the flash image using proset. default value is 0. 4 dlws disable legacy wakeup support. if this bit is set to 1, the user is not allowed to change the legacy os wakeup support menu option. default value is 0. 3 dbs disable boot selection. if this bit is set to 1, the user is not allowed to change the boot order menu option. default value is 0. 2 dps disable protocol select. if set to 1, the user is not allowed to change the boot protocol. default value is 0.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 177 3.4.2.4.3 pxe version ? word 0x32 word 32h of the eeprom is used to store the version of the boot agent that is stored in the flash image. when the boot agent loads, it can check this value to determine if any first-time configuration needs to be performed. the agent then updates this word with its version. some diagnostic tools to report the version of the boot agent in the flash also read this word. the format of this word is: 3.4.2.4.4 iba capabilities ? word 0x33 word 33h of the eeprom is used to enumerate the boot technologies that have been programmed into the flash. this is updated by flash configuration tools and is not updated or read by iba. 3.4.2.4.5 setup options pci function 1 ? word 0x34 this word is the same as word 30h, but for function 1 of the device. 3.4.2.4.6 configuration customization options pci function 1 ? word 0x35 this word is the same as word 31h, but for function 1 of the device. 3.4.2.4.7 setup options pci function 2 ? word 0x38 this word is the same as word 30h, but for function 2 of the device. 1dtm disable title message. if this bit is set to 1, the title message displaying the version of the boot agent is suppressed; the control-s message is also suppressed. this is for oems who do not wish the boot agent to display any messages at system boot. default value is 0. 0 dsm disable setup menu. if this bit is set to 1, the user is not allowed to invoke the setup menu by pressing control-s. in this case, the eeprom may only be changed via an external program. default value is 0. bit(s) name function 15 - 12 maj pxe boot agent major version. default value is 0. 11 ? 8 min pxe boot agent minor version. default value is 0. 7 ? 0 bld pxe boot agent build number. default value is 0. bit(s) name function 15 - 14 sig signature. must be set to 01 to indicate that this word has been programmed by the agent or other configuration software. 13 ? 5 rfu reserved. must be 0. 4 iscsi iscsi boot is present in flash if set to 1. 3 efi efi undi driver is present in flash if set to 1. 2 rpl rpl module is present in flash if set to 1. 1 undi pxe undi driver is present in flash if set to 1. 0 bc pxe base code is present in flash if set to 1.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 178 october 2010 3.4.2.4.8 configuration customization options pci function 2 ? word 0x39 this word is the same as word 31h, but for function 2 of the device. 3.4.2.4.9 setup options pci function 3 ? word 0x3a this word is the same as word 30h, but for function 3 of the device. 3.4.2.4.10 configuration customization options pci function 3 ? word 0x3b this word is the same as word 31h, but for function 3 of the device. 3.4.2.5 eeprom checksum calculation #define ixgbe_eeprom_checksum 0x3f #define ixgbe_eeprom_sum 0xbaba #define ixgbe_pcie_analog_ptr 03 #define ixgbe_fw_ptr 0f static u16 ixgbe_eeprom_calc_checksum(struct ixgbe_hw *hw) { u16 i; u16 j; u16 checksum = 0; u16 length = 0; u16 pointer = 0; u16 word = 0; /* include 0x0-0x3f in the checksum */ for (i = 0; i < ixgbe_eeprom_checksum; i++) { if (ixgbe_eeprom_read(hw, i, &word) != ixgbe_success) { debugout("eeprom read failed\n"); break; } checksum += word; } /* include all data from pointers except for the fw pointer */ for (i = ixgbe_pcie_analog_ptr; i < ixgbe_fw_ptr; i++) { ixgbe_eeprom_read(hw, i, &pointer); /* make sure the pointer seems valid */ if (pointer != 0xffff && pointer != 0) { ixgbe_eeprom_read(hw, pointer, &length); if (length != 0xffff && length != 0) { for (j = pointer+1; j <= pointer+length; j++) { ixgbe_eeprom_read(hw, j, &word); checksum += word; } } } }
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 179 checksum = (u16)ixgbe_eeprom_sum ? checksum; return checksum; } 3.4.3 hardware eeprom sections 3.4.3.1 eeprom init section the init section (eeprom control word 0x1, 0x2, and 0x38) are read after a pe_rst_n, lan_pwr_good, or internal power on reset. 3.4.3.1.1 eeprom control word 1 ? address 0x00 bits name default description 15:12 reserved 0000b reserved. 11:8 eeprom size 0010b these bits indicate the eeprom?s actual size. mapped to eec[14:11]. supported values: 0000b = reserved. 0001b = 256 bytes. 0010b = 512 bytes. 0011b = 1 kb. 0100b = 2 kb. 0101b = 4 kb. 0110b = 8 kb. 0111b = 16 kb. 1000b = 32 kb. 1001b: 1111b = reserved. 7:6 signature 01b the signature field indicates to the 82598 that there is a valid eeprom present. if the signature field is not 01b, the other bits in this word are ignored, no further eeprom read is performed, and the default values are used for the configuration space ids. 5 mng enable 0b manageability enable when set, indicates that the manageability block is enabled. when cleared, the manageability block is disabled (clock gated). mapped to grc.mng_en. 4 eeprom protection 0b if set to 1b, all eeprom protection schemes are enabled. 3:0 hepsize 0000b hidden eeprom block size this field defines the eeprom area accessible only by manageability firmware. it can also be used to store secured data and other manageability functions. the size in bytes of the secured area equals: 0 bytes (if hepsize equals zero), or 2^ hepsize bytes (2 bytes, 4 bytes, ?32 kb.)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 180 october 2010 3.4.3.1.2 eeprom control word 2 ? address 0x01 3.4.3.1.3 eeprom control word 3 ? address 0x38 3.4.3.2 eeprom hardware pointers most of eeprom words (0x0:0xf) contain hardware pointers to different hardware sections. note that if a pointer field is 0xffff the appropriate section that the pointer is referring to is not present in the eeprom. 3.4.3.2.1 analog configuration sections ? words 0x04:0x05 ? port 0 configuration pointer ? port 1 configuration pointer these sections are loaded after lan_pwr_good or internal power on reset and contain the analog default configurations for 82598's analog parts. words 0x4-0x5 are the pointers for these sections (the exact eeprom address, in words). the structure of all sections is similar as listed in the following table: bits name default description 15:12 reserved 0000b reserved. 3 deadlock timeout enable 1b if set, an 82598 that was granted access to the eeprom that does not toggle the interface for one second has the grant revoked. 2 core pll gate disable 0b when set, disables the gating of the core pll in 82598 low power states. 1 core clocks gate disable 0b when set, disables the gating of the core clock in 82598 low power states. 0 pcie pll gate disable 0b when set, disables the gating of the pcie pll in l1/l2 states. bits name default description 15:2 reserved 0b reserved. 1 apm enable port 1 0b initial value of advanced power management wake up enable in the general receive control register (grc.apme). mapped to grc.apme of port 1. 0 apm enable port 0 0b initial value of advanced power management wake up enable in the general receive control register (grc.apme). mapped to grc.apme of port 0. offset high byte low byte
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 181 3.4.3.2.1.1 eeprom analog configuration ? section length the section length word contains the length of the section in words. note that the sections length does not contain the section length word itself. 3.4.3.2.1.2 eeprom analog configuration ? data word each word in the analog configuration section has the same structure: bits 7:0 are the register address and bits 15:8 are the registers data. the analog registers are eight bits wide with an 8-bit address width. after reading the eeprom word, the register specified in bits 7:0 is loaded with the data from bits 15:8. 3.4.3.2.2 pcie analog pointer ? word 0x03 these sections are loaded only after pe_rst_n. these sections contain the analog default configurations for 82598's analog parts. word 0x3 is the pointer for this section (the exact eeprom address, in words). the structure of this section is listed in the following table: 3.4.3.2.2.1 pcie analog ? section length the section length word contains the length of the section in words. note that the sections length does not contain the section length word itself. 3.4.3.2.2.2 pcie analog selector each part of the pcie analog is reachable through a 2-byte bus (data/word). at the same time, access must signal which part of the pcie analog it targeted (sr0, sr1, ? sc). to map this access, the eeprom uses a structure of one pcie analog selector that indicates which internal target is accessed by the next eeprom word. section length 0x01 configuration data configuration address offset high byte low byte section length = 0xxx 0x1 pcie analog selector 1 0x2 pcie analog word 1 ? selector 1 0x3 pcie analog word 2 ? selector 1 0x4 pcie analog word 3 ? selector 1 0x5 pcie analog selector 2 0x6 pcie analog word 1? selector 2 ?.. ??
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 182 october 2010 3.4.3.2.2.3 pcie analog word 3.4.3.3 eeprom pcie general configuration section this section is loaded after a pcie power good or pcie in-band reset de-assertion. it contains general configuration for the pcie interface (not function specific) and is pointed to by word 0x06 in the eeprom (full-byte address; must be word aligned). bit name default description 15:8 selector tag = 0xff 0xff the 0xff value in this eeprom word identifies this word as a selector. 7:0 target id 0x0 identifies which internal pcie analog target is accessed by the following eeprom word. refer to the following table. target id target 00 sr lane 0 registers. 01 sr lane 1 registers. 02 sr lane 2 registers. 03 sr lane 3 registers. 04 sr lane 4 registers. 05 sr lane 5 registers. 06 sr lane 6 registers. 07 sr lane 7 registers. 08 sr registers of all lanes at the same time. 09 sc register. bit name default description 15:8 add 0x0 register address in the pcie ana target. 7:0 data 0x0 the value to write in the register pointed to by the address. offset high byte low byte section section length = 0x0b 3.4.3.3.1 0x01 pcie init configuration 1 3.4.3.3.2
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 183 3.4.3.3.1 pcie general configuration ? section length the section length word contains the length of the section in words. note that the sections length does not contain the section length word itself. 3.4.3.3.2 pcie init configuration 1 ? offset 1 0x02 pcie init configuration 2 3.4.3.3.4 0x03 pcie init configuration 3 3.4.3.3.4 0x04 pcie control offset 4 3.4.3.3.5 0x05 pcie control offset 5 3.4.3.3.6 0x06 pcie control offset 6 3.4.3.3.7 0x07 pcie control offset 7 3.4.3.3.8 0x08 pcie control offset 8 3.4.3.3.9 0x09 pcie control offset 9 3.4.3.3.10 0x0a pcie control offset 10 3.4.3.3.11 0x0b pcie control offset 11 3.4.3.3.12 bit name default description 15 l0s enable 0b if the l0s enable bit is set, the default value of the active state link pm control field in the pcie link control register is set to 01b (l0s entry enabled). 14:12 l1_act_ext_latency 110b l1 active exit latency for the configuration space default = (32 s-64 s). defined encoding: 000b = less than 1 ? s. 001b = 1 ? s ? 2 ? s. 010b = 2 ? s ? 4 ? s. 011b = 4 ? s ? 8 ? s. 100b = 8 ? s ? 16 ? s. 101b = 16 ? s ? 32 ? s. 110b = 32 ? s ? 64 ? s. 111b = more than 64 ? s. these bits configure the initial hardware value of the pci configuration, link cap, and l1 exit latency registers following power up. bit name default description
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 184 october 2010 11:9 l1_act_acc_latency 110b l1 active acceptable latency for the configuration space default = (32 s-64 s). defined encoding: 000b = less than 1 ? s. 001b = 1 ? s ? 2 ? s. 010b = 2 ? s ? 4 ? s. 011b = 4 ? s ? 8 ? s. 100b = 8 ? s ? 16 ? s. 101b = 16 ? s ? 32 ? s. 110b = 32 ? s ? 64 ? s. 111b = no limit. these bits configure the initial hardware value of the pci configuration, device cap, and endpoint l1 acceptable latency registers following power up. 8:6 l0s_acc_latency 011b l0s acceptable latency for the configuration space default = (512 ns). defined encoding: 000b = less than 64 ns. 001b = 64 ns ? 128 ns. 010b = 128 ns ? 256 ns. 011b = 256 ns ? 512 ns. 100b = 512 ns ? 1 ? s. 101b = 1 ? s ? 2 ? s. 110b = 2 ? s ? 4 ? s. 111b = no limit. these bits configure the initial hardware value of the pci configuration, device cap, and endpoint l0s acceptable latency registers following power up. 5:3 l0s_se_ext_latency 110b l0s exit latency for active state power management (separated reference clock) ? (latency between 2 s ? 4 s). defined encoding: 000b = less than 64 ns. 001b = 64 ns ? 128 ns. 010b = 128 ns ? 256 ns. 011b = 256 ns ? 512 ns. 100b = 512 ns ? 1 ? s. 101b = 1 ? s ? 2 ? s. 110b = 2 ? s ? 4 ? s. 111b = more than 4 ? s. these bits configure the initial hardware value of the pci configuration, link cap, and l0s exit latency registers (when working with a separate clock) following power up. 2:0 l0s_co_ext_latency 110b l0s exit latency for active state power management (common reference clock) ? (latency between 2 s ? 4 s). defined encoding: 000b = less than 64 ns. 001b = 64 ns ? 128 ns. 010b = 128 ns ? 256 ns. 011b = 256 ns ? 512 ns. 100b = 512 ns ? 1 ? s. 101b = 1 ? s ? 2 ? s. 110b = 2 ? s ? 4 ? s. 111b = more than 4 ? s. these bits configure the initial hardware value of the pci configuration, link cap, and l0s exit latency registers (when working with a common clock) following power up.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 185 3.4.3.3.3 pcie init configuration 2 ? offset 2 3.4.3.3.4 pcie init configuration 3 ? offset 3 bit name default description 15:12 reserved 0b reserved. 11:8 extra nfts 0x7 extra number of fast training signal (nfts) that is added to the original requested number of nfts (as requested by the upstream component). 7:0 nfts 0xb0 number of special sequences for l0s transition to l0. the 82598 requires at least 0xb0 nfts for proper functionality. bit name default description 15 master_enable 0b when set to 1b, this bit enables the phy to be a master (upstream component/ cross link functionality). 14 scram_dis 0b scrambling disable when set to 1b, this bit disables pcie lfsr scrambling. 13 ack_nak_sch 0b ack/nak scheme 0b = scheduled for transmission following any tlp. 1b = scheduled for transmission according to timeouts specified in the pcie specification. 12 cache_lsize 0b cache line size 0b = 64 bytes. 1b = 128 bytes. 11:10 gio_cap 10b pcie capability version this field must be set to 10b to use extended configuration capability (used for a timeout mechanism). this bit is mapped to gcr.pcie_capability_version. 9 io_sup 1b i/o support (effects i/o bar request). when set to 1b, i/o is supported. 8 packet_size 1b default packet size 0b = 128 bytes. 1b = 256 bytes. 7:6 lane_width 11b max link width 00b = 1 lane. 01b = 2 lanes. 10b = 4 lanes. 11b = 8 lanes. 5 elastic buffer diff1 0b when set to 1b, the elastic buffers are activated in a more limited mode (read and write pointers distance wise). 4 elastic buffer ctrl 0b when set to 1b, sets the elastic buffers to a mode that sets phase-only mode during electrical-idle states. 3:2 act_stat_pm_sup 11b determines support for active state link power management (aslpm). loaded into the pcie active state link pm support register.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 186 october 2010 3.4.3.3.5 pcie control ? offset 4 bit name default description 1 slot_clock_cfg 1b when set, 82598 uses the pcie reference clock supplied on the connector (for add-in solutions). 0 loop back polarity inversion 0b checks the polarity inversion in a loop-back master entry. bit name default description 15 reserved 0b reserved. 14 dllp timer enable 0b when set, enables the dllp timer counter. 13 gio down reset disable 0b disables a core reset when the pcie link goes down. 12 lane reversal disable 0b disables the ability to negotiate a lane reversal. 11 good recovery 0b when this bit is set, the ltssm recovery states always progress towards linkup (force a good recovery when recovery occurs). 10 leaky bucket disable 1b disables the leaky bucket mechanism in the pcie phy. disabling this mechanism holds the link from going to a recovery retrain in case of disparity errors. 9:7 reserved 0b reserved. 6 gio ts retrain mode 0b controls the condition of an ltssm entry to recovery. 5 l2 disable 0b disables the link from entering the l2 state. 4 skip disable 0b disables the skip symbol insertion in the elastic buffer. 3 reserved 0b reserved. 2 electrical idle 0b electrical idle mask if set to 1b, disables a check for an illegal electrical idle sequence (for example, eidle ordered set without common mode and vise versa) and excepts any of them as the correct eidle sequence. note: the specification can be interpreted so that the eidle ordered set is sufficient for a transition to any of the power management states. the use of this bit enables such interpretation and avoids the possibility of correct behavior being understood as illegal sequences. 1:0 latency_to_enter_l1 11b period (in the l0s state) before transitioning into an l1 state. 00b = 64 s. 01b = 256 s. 10b = 1 ms. 11b = 4 ms.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 187 3.4.3.3.6 pcie control ? offset 5 bit name default description 15:11 reserved 0b reserved. 10 lan function select 0b when the lan function select field = 0b, lan 0 is routed to pci function 0 and lan 1 is routed to pci function 1. if the lan function select field = 1b, lan 0 is routed to pci function 1 and lan 1 is routed to pci function 0. this bit is mapped to factps[30]. 9:8 reserved 0b reserved. 7 completion timeout disable 0b disables the pcie completion timeout mechanism. this bit is mapped to gcr.completion_timeout_disable. 0b = completion timeout enabled. 1b = completion time out disabled. 6:5 completion timeout value 00b determines the range of the pcie completion timeout. 00b = 0.5 ms to 1 ms. 01b = 50 ms to 100 ms. 10b ? 0.5 s to 1 s. 11b = 10 s to 20 s. 4 completion timeout resend 1b when set, enables a response to a request once the completion timeout expired. this bit is mapped to gcr.completion_timeout_resend. 0b = do not resend request on completion timeout. 1b = resend request on completion timeout. 3 dummy function enable 0b enables support for dummy function when only function is needed. 0b = disable. 1b = enable. 2 wake_pin_enable 1b enables the use of the wake pin for a pme event in all power states. 1 lan pci disable 0b lan pci disable when set to 1b, one lan port is disabled and the appropriate pci function might be disabled and act as a dummy function. the function that is disabled is determined by the lan pci function select field. if the disabled function is function 0, it acts as a dummy function. 0 lan disable select 0b lan disable select 0b = lan 0 is disabled. 1b = lan 1 is disabled.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 188 october 2010 3.4.3.3.7 pcie control ? offset 6 ? lan power consumption 3.4.3.3.8 pcie control ? offset 7 3.4.3.3.9 pcie control ? offset 8 ? sub-system id if the load sub-system ids in offset 0x7 of this section is set, this word is read in to initialize the sub- system id. the default value is 0x0. bit name default description 15:8 lan d0 power 0x0 the value in this field is reflected in the pci power management data register of the lan functions for d0 power consumption and dissipation ( data_select = 0 or 4). power is defined in 100 mw units. the power includes also the external logic required for the lan function. 7:5 function 0 common power 0x0 the value in this field is reflected in the pci power management data register of function 0 when the data_select field is set to 8 (common function). the msbs in the data register that reflects the power values are padded with zeros. when one port is used, this field should be set to 0b. 4:0 lan d3 power 0x0 the value in this field is reflected in the pci power management data register of the lan functions for d3 power consumption and dissipation ( data_select = 3 or 7). power is defined in 100 mw units. the power includes also the external logic required for the lan function. the msbs in the data register that reflects the power values are padded with zeros. bit name default description 15:11 reserved 0x0 reserved. 10:8 flash size 000b indicates flash size 000b = 64 kb. 001b = 128 kb. 010b = 256 kb. 011b = 512 kb. 100b = 1 mb. 101b = 2 mb. 110b = 4 mb. 111b = 8 mb. the flash size impacts the requested memory space for the flash and expansion rom bars in pcie configuration space. 7 reserved 0b reserved. 6:2 go electrical idle delay 0b permits a tune delay between the electrical idle symbol sent on the physical lane and the go-electrical idle command to gio-ana. 1 load subsystem ids 1b when set to 1b, indicates that the function is to load its pcie sub-system id and sub-system vendor id from the eeprom (offset 0x8 and 0x9 in this section). 0 load device id 1b when set to 1b, indicates that the function is to load its pci device id from the eeprom (offset 10 in this section and offset 2 in pcie configuration space 0/1 section).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 189 3.4.3.3.10 pcie control ? offset 9 ? sub-system vendor id if the load sub-system ids in offset 0x7 of this section is set, this word is read in to initialize the sub- system vendor id. the default value is 0x8086. 3.4.3.3.11 pcie control ? offset 10 ? dummy device id if the load vendor/device ids in offset 0x7 of this section is set, this word is read in to initialize the device id of the dummy device in this function (if enabled). the default value is 0x10a6 . 3.4.3.3.12 pcie control ? offset 11 ? device revision id 3.4.3.4 eeprom pcie configuration space 0/1 sections word 0x7 points on the pcie configuration space defaults of function 0 while word 0x8 points to function 1 defaults. both sections are loaded at the de-assertion of lan_pwr_good, internal power on reset, and a pcie in-band reset. in addition, function 0 defaults are loaded after the de-assertion of pcie config 0 reset; function 1 defaults are loaded after the de-assertion of pcie config 1 reset. the structure of both sections is identical as listed in the following table: 3.4.3.4.1 pcie configuration space 0/1 ? section length the section length word contains the length of the section in words. note that the sections length does not contain the section length word itself. bit name default description 7:0 devrevid 0x0 device rev id the actual device revision id is the eeprom value xored with the hardware value (0x00 for 82598 a-0). offset high byte low byte section section length = 0x2 3.4.3.4.1 0x1 pcie configuration space 0/1 control 1 3.4.3.4.2 0x2 pcie configuration space 0/1 control 2 3.4.3.4.3
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 190 october 2010 3.4.3.4.2 eeprom pcie configuration space 0/1- offset 1 the following table lists the different combinations for bits 9 and 8. 3.4.3.4.3 eeprom pcie configuration space 0/1 ? offset 2 device id if the load vendor/device ids in offset 0x7 of section pcie general configuration is set, this word is read in to initialize the device id of the lan function. the default value is 10b6. 3.4.3.5 eeprom core 0/1 section word 0x9 points to the core configuration defaults of core 0 while word 0xa points to core 1 defaults. both sections are loaded at the de-assertion of their core master reset. the structure of both sections is identical as listed in the following table: bit name default description 15:10 reserved 0x0 reserved. 9 lan flash disable 1b a value of 1b disables the flash logic. the flash access bar in the pci configuration space is also disabled. 8 lan boot disable 1b a value of 1b disables the expansion rom bar in the pci configuration space. 7 interrupt pin 0b for lan0 1b for lan1 controls the value advertised in the interrupt pin field of the pci configuration header for this device/function. a value of 0b, reflected in the interrupt pin , field indicates that 82598 uses inta#; a value of 1b indicates that 82598 uses intb#. when one port is used, the configuration should be aligned to make sure inta# is used. 6:5 reserved 00b reserved. 4:0 msi_x _n 0x10 this field specifies the number of entries in the msi-x tables for this function. msi_x_n is equal to the number of entries minus one. for example, a return value of 0x7 means eight vectors are available. the 82598 supports a maximum of 16 vectors. bit 9 (flash disable) bit 8 (boot disable) functionality (active windows) 0b 0b flash and expansion rom bars are active. 0b 1b flash bar is enabled and expansion rom bar is disabled. 1b 0b reserved 1b 1b flash and expansion rom bars are disabled. offset high byte low byte section section length = 0x7 3.4.3.5.1 0x1 ethernet address byte 2 ethernet address byte 1 3.4.3.5.2
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 191 3.4.3.5.1 core configuration section ? section length the section length word contains the length of the section in words. note that the sections length does not contain the section length word itself. 3.4.3.5.2 ethernet address ? offset 1-3 the ethernet individual address (ia) is a 6-byte field that must be unique for each nic and must also be unique for each copy of the eeprom image. the first three bytes are vendor specific. for example, the ia is equal to [00 aa 00] or [00 a0 c9] for intel products. the value of this field is loaded into the receive address register 0 (ral0/rah0). for the purpose of this datasheet, the ia byte numbering convention is as follows: 0x2 ethernet address byte 4 ethernet address byte 3 3.4.3.5.2 0x3 ethernet address byte 6 ethernet address byte 5 3.4.3.5.2 0x4 led 1 configuration led 0 configuration 3.4.3.5.3 0x5 led 3 configuration led 2 configuration 3.4.3.5.3 0x6 sdp control 3.4.3.5.4 0x7 filter control 3.4.3.5.5 vendor 1 2 3 4 5 6 intel original 00 aa 00 variable variable variable intel new 00 a0 c9 variable variable variable
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 192 october 2010 3.4.3.5.3 leds configuration ? offset 4-5 the ledctl register defaults are loaded from these two words as listed in the following table: note: the content of the eeprom words is similar to the register content. 3.4.3.5.4 sdp control ? offset 6 led ledctl bits eprom byte led 0 control 7:0 word 0x4 (low byte). led 1 control 15:8 word 0x4 (high byte). led 2 control 23:16 word 0x5 (low byte). led 3 control 31:241 word 0x5 (high byte). bit name default description 15:12 reserved 0000b should be set to 0000b. 11 sdpdir[3] 0b sdp3 pin ? initial direction mapped to esdp.sdp3_iodir. this bit configures the initial hardware value of the sdp3_iodir bit in the esdp register following power up. 10 sdpdir[2] 0b sdp2 pin ? initial direction mapped to esdp.sdp2_iodir. this bit configures the initial hardware value of the sdp2_iodir bit in the esdp register following power up. 9 sdpdir[1] 0b sdp1 pin ? initial direction mapped to esdp.sdp1_iodir. this bit configures the initial hardware value of the sdp1_iodir bit in the esdp register following power up. 8 sdpdir[0] 0b sdp0 pin ? initial direction mapped to esdp.sdp0_iodir. this bit configures the initial hardware value of the sdp0_iodir bit in the esdp register following power up. 7:4 reserved 0x0 reserved. 3 sdpval[3] 0b sdp3 pin ? initial output value mapped to esdp.sdp3_data. this bit configures the initial power on value output of sdp3 (when configured as an output) by configuring the initial hardware value of the sdp3_data bit in the esdp register following power up. 2 sdpval[2] 0b sdp2 pin ? initial output value mapped to esdp.sdp2_data. this bit configures the initial power on value output of sdp2 (when configured as an output) by configuring the initial hardware value of the sdp2_data bit in the esdp register following power up.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 193 3.4.3.5.5 filter control ? offset 7 3.4.3.6 eeprom mac 0/1 sections word 0xb points to the lan mac configuration defaults of function 0 while word 0xc points to function 1 defaults. both sections are loaded at the de-assertion of their core master reset. the structure of both sections is identical as listed in the following table: 3.4.3.6.1 mac configuration section ? section length the section length word contains the length of the section in words. note that the sections length does not contain the section length word itself. bit name default description 1 sdpval[1] 0b sdp1 pin ? initial output value mapped to esdp.sdp1_data. this bit configures the initial power on value output of sdp1 (when configured as an output) by configuring the initial hardware value of the sdp1_data bit in the esdp register following power up. 0 sdpval[0] 0b sdp0 pin ? initial output value mapped to esdp.sdp0_data. this bit configures the initial power on value output of sdp0 (when configured as an output) by configuring the initial hardware value of the sdp0_data bit in the esdp register following power up. bit name default description 15:1 reserved 0b reserved. 0 advd3wuc 1b d3cold wakeup capability advertisement enable when set, d3cold wakeup capability is advertised based on whether or not aux_pwr advertises the presence of auxiliary power. offset high byte low byte section section length = 0x5 3.4.3.6.1 0x1 link mode configuration 3.4.3.6.2 0x2 swap configuration 3.4.3.6.3 0x3 swizzle and polarity configuration 3.4.3.6.4 0x4 auto negotiation default bits 3.4.3.6.5 0x5 autoc2 upper half 3.4.3.6.6
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 194 october 2010 3.4.3.6.2 link mode configuration ? offset 1 bit name default description 15:13 link mode select 001b selects the active link mode. 000b = 1 gb/s link (no auto negotiation). 001b = 10 gb/s link (no auto negotiation). 010b = 1 gb/s link with clause 37 auto negotiation enable. 011b = reserved. 100b = kx4/kx auto negotiation enable. 1 gb/s (clause 37) auto negotiation disable. 101b = reserved. 110b = kx4/kx auto negotiation enable. 1 gb/s (clause 37) auto negotiation enable. 111b = reserved. these bits are mapped to autoc.lms. 12 restart an 0b restarts the kx/kx4 auto negotiation process (self-clearing bit). 0b = no action needed. 1b = restart kx/kx4 auto negotiation. this bit is mapped to autoc.restart_auto negotiation. 11 ratd 0b restarts auto negotiation on a transition to dx. this bit is loaded to autoc.ratd and mapped to autoc.ratd. 10 d10gmp 0b disables 10 gb/s (kx4) on dx(dr/d3) without main power. this bit is loaded to autoc.d10odg and mapped to autoc.d10gmp. 9 1g pma_pmd 1b pma/pmd used for 1 gb/s. 0b = bx pma/pmd. 1b = kx pma/pmd. this bit is mapped to autoc.1g_pma_pmd. 8:7 10g pma_pmd 00b pma/pmd used for 10 gb/s. 00b = xaui pma/pmd. 01b = kx4 pma/pmd. 10b = cx4 pma/pmd. 11b = reserved. these bits are mapped to autoc.10g_pma_pmd. 6:2 ansf 00001b an selector field this value is used as the selector field in the link control word during the clause 73 auto-negotiation process (default value is according to 802.3ap, draft 2.4). mapped to autoc.ansf. 1 anack2 0b an ack2 field this value is transmitted in the acknowledge2 field of the null next page that is transmitted during a next page handshake. mapped to autoc.anack2. 0 reserved 0b reserved.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 195 3.4.3.6.3 swap configuration ? offset 2 bit name default description 15:14 swap_rx_lane_0 00b determines which port lane is mapped to mac rx lane 0. 00b = port rx lane 0 to mac rx lane 0. 01b = port rx lane 1 to mac rx lane 0. 10b = port rx lane 2 to mac rx lane 0. 11b = port rx lane 3 to mac rx lane 0. mapped to serdesc.swap_rx_lane_0. 13:12 swap_rx_lane_1 01b determines which port lane is mapped to mac rx lane 1. mapped to serdesc.swap_rx_lane_1. 11:10 swap_rx_lane_2 10b determines which port lane is mapped to mac rx lane 2. mapped to serdesc.swap_rx_lane_2. 9:8 swap_rx_lane_3 11b determines which port lane is mapped to mac rx lane 3. mapped to serdesc.swap_rx_lane_3. 7:6 swap_tx_lane_0 00b determines the port destination tx lane for mac tx lane 0. 00b = mac tx lane 0 to port tx lane 0. 01b = mac tx lane 0 to port tx lane 1. 10b = mac tx lane 0 to port tx lane 2. 11b = mac tx lane 0 to port tx lane 3. mapped to serdesc.swap_tx_lane_0. 5:4 swap_tx_lane_1 01b determines the port destination tx lane for mac tx lane 1. mapped to serdesc.swap_tx_lane_1. 3:2 swap_tx_lane_2 10b determines the port destination tx lane for mac tx lane 2. mapped to serdesc.swap_tx_lane_2. 1:0 swap_tx_lane_3 11b determines the port destination tx lane for mac tx lane 3. mapped to serdesc.swap_tx_lane_3.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 196 october 2010 3.4.3.6.4 swizzle and polarity configuration ? offset 3 bit name default description 15:12 swizzle_rx 0x0 swizzle_rx[0] ? swizzles the bits of mac rx lane 0. swizzle_rx[1] ? swizzles the bits of mac rx lane 1. swizzle_rx[2] ? swizzles the bits of mac rx lane 2. swizzle_rx[3] ? swizzles the bits of mac rx lane 3. swizzles the bits if set to 1b. mapped to serdesc.swizzle_rx_lanes. 11:8 swizzle_tx 0x0 swizzle_tx[0] ? swizzles the bits of mac tx lane 0. swizzle_tx[1] ? swizzles the bits of mac tx lane 1. swizzle_tx[2] ? swizzles the bits of mac tx lane 2. swizzle_tx[3] ? swizzles the bits of mac tx lane 3. swizzles the bits if set to 1b. mapped to serdesc.swizzle_tx_lanes. 7:4 polarity_rx 0x0 polarity_rx[0] ? changes the bit polarity of mac rx lane 0 polarity_rx[1] ? changes the bit polarity of mac rx lane 1 polarity_rx[2] ? changes the bit polarity of mac rx lane 2 polarity_rx[3] ? changes the bit polarity of mac rx lane 3 changes bit polarity if set to 1b. mapped to serdesc.rx_lanes_polarity. 3:0 polarity_tx 0x0 polarity_tx[0] ? changes the bit polarity of mac tx lane 0. polarity_tx[1] ? changes the bit polarity of mac tx lane 1. polarity_tx[2] ? changes the bit polarity of mac tx lane 2. polarity_tx[3] ? changes the bit polarity of mac tx lane 3. changes bit polarity if set to 1b. mapped to serdesc.tx_lanes_polarity.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 197 3.4.3.6.5 auto negotiation defaults ? offset 4 bit name default description 15:14 kx support 1b the value of these eeprom settings are shown in bits a0:a1 of the technology ability field of the auto negotiation word. 00b = illegal value. 01b = a0 = 1b, a1 = 0b. kx supported. kx4 not supported. 10b = a0 = 0b, a1 = 1b. kx not supported. kx4 supported. 11b = a0 = 1b, a1 = 1b. kx supported. kx4 supported. mapped to autoc.kx_support. 13:12 pause bits 0x00 the value of these bits is loaded to bits d11:d10 of the link code word (pause data). bit 12 is loaded to d11. mapped to autoc.pb. 11 rf 0b this bit is loaded to the rf of the auto negotiation word. mapped to autoc.rf. 10:9 an parallel detect timer 00b configures the parallel detect counters. 00b = 1 ms. 01b = 2 ms. 10b = 5 ms. 11b = 8 ms. mapped to autoc.anpdt. 8 an rx loose mode 1b enables less restricted functionality (allow 9/11 bit symbols). 0b = disables loose mode. 1b = enables loose mode. mapped to autoc.anrxlm. 7 an rx drift mode 1b enables the drift caused by ppm in the rx data. 0b = disables drift mode. 1b = enables drift mode. mapped to autoc.anrxdm. 6:2 an rx align threshold 00011b sets the threshold to determine that the alignment is stable. sets how many stable symbols to find before declaring the an_rx 10b symbol stable. mapped to autoc.anrxat. 1:0 reserved 00b reserved.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 198 october 2010 3.4.3.6.6 autoc2 ? upper half? offset 5 3.4.4 hardware section ? auto-read the following table lists the different sections of auto-read events. table 3-46. eeprom section auto-read bit name default description 15 reserved 0b reserved. 14 parallel detect disable 0b disables the parallel detect part in kx/kx4 auto negotiation. when set to 1b, the auto negotiation process avoids any parallel detect activity and relies only on the dme pages receive and transmit. 1b = reserved. 0b = enable the parallel detect (normal operation). mapped to autoc2.pdd. 13:8 reserved 0x0 reserved 7 latch high 10g aligned indication 0b override any deskew alignment failures in the 10 gb/s link (by latching high). this keeps the link up after the first time it reached the an_good state in 10 gb/s (unless restartan is set). mapped to autoc2.lh1gai. 6 reserved 0b reserved. 5:4 an advertisement page override 00b override the auto negotiation advertisement page with data from the autoc3 register. 00b = use internal values (default). mapped to autoc2.anapo. 3:0 reserved 0x0 reserved. function internal power on reset or lan_ pwr_ good pe_rst_ n pcie inband reset function 0 d3 to d0 sw reset 0 link reset 0 function 1 d3 to d0 sw reset 1 link reset 1 pcie analog configuration x core 0 configuration x core 1 configuration x pcie general configuration x pcie function 0 config space xxx pcie function 1 config space xx x
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 199 3.4.5 manageability control sections the following table lists the eeprom global offsets that are used by 82598 firmware: 3.4.5.1 common firmware pointers word 0x0f is used to point to firmware structures. function internal power on reset or lan_ pwr_ good pe_rst_ n pcie inband reset function 0 d3 to d0 sw reset 0 link reset 0 function 1 d3 to d0 sw reset 1 link reset 1 core 0 configuration xxxxx core 1 configuration xx xxx mac core 0 configuration x 1 x 1 x 1 x 1 x mac core 1 configuration x 1 x 1 x 1 x 1 x 1. the core and mac core configuration sections are auto-read after the appropriate event only if the manageability unit is disa bled. global offset description section 0x0 test configuration pointer 3.4.5.1.1 0x1 loader patch pointer 3.4.5.1.2 0x2 no manageability patch pointer 3.4.5.1.3 0x3 manageability capability/manageability enable 3.4.5.1.3.1 0x4 pass through patch configuration pointer 3.4.5.1.6.1.1 0x5 pass through lan 0 configuration pointer 3.4.5.1.6.1.2 0x6 sideband configuration pointer 3.4.5.1.6.1.3 0x7 flexible tco filter configuration pointer 3.4.5.1.6.1.4 0x8 pass through lan 1 configuration pointer 3.4.5.1.6.1.5 0x9 nc-si microcode download pointer 3.4.5.1.6.1.6 0xa nc-si configuration pointer
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 200 october 2010 3.4.5.1.1 test configuration pointer ? (global offset 0x0) 3.4.5.1.2 loader patch pointer ? (global offset 0x1) 3.4.5.1.3 no manageability patch pointer ? (global offset 0x2) 3.4.5.1.3.1 manageability capability/manageability enable ? (global offset 0x3) bit name description 15:0 pointer pointer to test configuration structure. bit name description 15:0 pointer pointer to loader patch structure. bit name description 15:0 pointer pointer to no manageability patch structure. bit name description 15 reserved reserved 14 sideband interface 0b = smbus. 1b = nc-si. 13:11 reserved reserved. 10:8 manageability mode 0x0 = none. 0x1 = reserved. 0x2 = pt mode. 0x3:0x7 = reserved. 7 port1 manageability cable 0b = reserved. 1b = bits 3:0 are applicable to port 1. 6 port0 manageability cable 0b = reserved. 1b = bits 3:0 are applicable to port 0. 5 lan1 force tco reset disable 0b = enable force tco reset on lan1. 1b = disable force tco reset on lan1. 4 lan0 force tco reset disable 0b = enable force tco reset on lan0. 1b = disable force tco reset on lan0.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 201 3.4.5.1.3.2 nc-si configuration pointer ? (global offset 0x4) 3.4.5.1.4 test structure 3.4.5.1.4.1 section header ? (offset 0x0) 3.4.5.1.4.2 loopback test configuration ? (offset 0x1) 3.4.5.1.5 patch structure this structure is used for all the patches in different modes (loader, no manageability and pass through). 3.4.5.1.5.1 patch data size ? (offset 0x0) bit name description 3 pass through cable 0b = disable. 1b = enable. 2:0 reserved reserved bit name description 15:0 pointer pointer to nc-si configuration pointer structure. bit name description 15:8 block crc 7:0 block length (words) bit name description 15:2 reserved 1 loopback test use sdp output 0 loopback test enable bit name description 15:0 data size (bytes)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 202 october 2010 3.4.5.1.5.2 block crc8? (offset 0x1) 3.4.5.1.5.3 patch entry point pointer low word ? (offset 0x2) 3.4.5.1.5.4 patch entry point pointer high word ? (offset 0x3) 3.4.5.1.5.5 patch version 1 word ? (offset 0x4) 3.4.5.1.5.6 patch version 2 word ? (offset 0x5) bit name description 15:8 reserved 7:0 crc8 bit name description 15:0 patch entry point pointer (low word) bit name description 15:0 patch entry point pointer (high word) bit name description 15:8 patch generation hour 7:0 patch generation minutes bit name description 15:8 patch generation month 7:0 patch generation day
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 203 3.4.5.1.5.7 patch version 3 word ? (offset 0x6) 3.4.5.1.5.8 patch version 4 word ? (offset 0x7) 3.4.5.1.5.9 patch data words ? (offset 0x8 ? block length) 3.4.5.1.6 pass through control words the following section describes the pointers and structures dedicated to pass through mode. 3.4.5.1.6.1 pass through pointers 3.4.5.1.6.1.1 pass through patch configuration pointer ? (global offset 0x4) 3.4.5.1.6.1.2 pass through lan 0 configuration pointer ? (global offset 0x5) bit name description 15:8 patch silicon version compatibility 7:0 patch generation year bit name description 15:8 patch major number 7:0 patch minor number bit name description 15:0 patch firmware data bit name description 15:0 pointer pointer to pass through patch configuration pointer structure. bit name description 15:0 pointer pointer to pass through lan 0 configuration pointer structure.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 204 october 2010 3.4.5.1.6.1.3 sideband configuration pointer ? (global offset 0x6) 3.4.5.1.6.1.4 flexible tco filter configuration pointer ? (global offset 0x7) 3.4.5.1.6.1.5 pass through lan 1 configuration pointer ? (global offset 0x8) 3.4.5.1.6.1.6 nc-si microcode download pointer ? (global offset 0x9) 3.4.5.1.6.2 pass through lan configuration structure 3.4.5.1.6.2.1 section header ? (0ffset 0x0) 3.4.5.1.6.2.2 lan 0 ipv4 address 0 (lsb) mipaf0 ? (0ffset 0x01) bit name description 15:0 pointer pointer to sideband configuration structure. bit name description 15:0 pointer pointer to flexible tco filter configuration pointer structure. bit name description 15:0 pointer pointer to pass through lan 1 configuration pointer structure. bit name description 15:0 pointer pointer to nc-si microcode download pointer structure. bit name description 15:8 block crc8 7:0 block length bit name description 15:8 lan 0 ipv4 address 0, byte 1 7:0 lan 0 ipv4 address 0, byte 0
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 205 3.4.5.1.6.2.3 lan 0 ipv4 address 0 (msb) (mipaf0) ? (0ffset 0x02) 3.4.5.1.6.2.4 lan 0 ipv4 address 1 mipaf1 ? (0ffset 0x03-x004) same structure as lan0 ipv4 address 0. 3.4.5.1.6.2.5 lan 0 ipv4 address 2 mipaf2 ? (0ffset 0x05-0x06) same structure as lan0 ipv4 address 0. 3.4.5.1.6.2.6 lan 0 ipv4 address 3 mipaf3 ? (0ffset 0x07-0x08) same structure as lan0 ipv4 address 0. 3.4.5.1.6.2.7 lan 0 mac address 0 (lsb) mmal0 ? (0ffset 0x09) 3.4.5.1.6.2.8 lan 0 mac address 0 (lsb) mmal0 ? (0ffset 0x0a) 3.4.5.1.6.2.9 lan 0 mac address 0 (msb) mmah0 ? (0ffset 0x0b) 3.4.5.1.6.2.10 lan 0 mac address 1 mmal/h1 ? (0ffset 0x0c-0x0e) same structure as lan0 mac address 0. bit name description 15:8 lan 0 ipv4 address 0, byte 3 7:0 lan 0 ipv4 address 0, byte 2 bit name description 15:8 lan 0 mac address 0, byte 1 7:0 lan 0 mac address 0, byte 0 bit name description 15:8 lan 0 mac address 0, byte 3 7:0 lan 0 mac address 0, byte 2 bit name description 15:8 lan 0 mac address 0, byte 5 7:0 lan 0 mac address 0, byte 4
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 206 october 2010 3.4.5.1.6.2.11 lan 0 mac address 2 mmal/h2 ? (0ffset 0x0f-0x11) same structure as lan0 mac address 0. 3.4.5.1.6.2.12 lan 0 mac address 3 mmal/h3 ? (0ffset 0x12-0x14) same structure as lan0 mac address 0. 3.4.5.1.6.2.13 lan 0 udp flexible filter ports 0 ? 15 (mfutp registers) ? (0ffset 0x15-0x24) 3.4.5.1.6.2.14 lan 0 vlan filter 0 ? 7 (mavtv registers) ? (0ffset 0x25 ? 0x2c) 3.4.5.1.6.2.15 lan 0 manageability filters valid (mfval lsb) ? (0ffset 0x2d) 3.4.5.1.6.2.16 lan 0 manageability filters valid (mfval msb) ? (0ffset 0x2e) bit name description 15:0 lan udp flexible filter value bit name description 15:12 reserved 11:0 lan 0 vlan filter value bit name description 15:8 vlan indicates if the vlan filter registers (mavtv) contain valid vlan tags. bit 8 corresponds to filter 0, etc. 7:4 reserved reserved. 3:0 mac indicates if the mac unicast filter registers (mmah, mmal) contain valid mac addresses. bit 0 corresponds to filter 0, etc. bit name description 15:12 reserved reserved. 11:8 ipv6 indicates if the ipv6 address filter registers (mipaf) contain valid ipv6 addresses. bit 8 corresponds to address 0, etc. bit 11 (filter 3) applies only when ipv4 address filters are not enabled (manc.en_ipv4_filter=0). 7:4 reserved reserved. 3:0 ipv4 indicates if the ipv4 address filters (mipaf) contain a valid ipv4 address. these bits apply only when ipv4 address filters are enabled (manc.en_ipv4_filter=1).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 207 3.4.5.1.6.2.17 lan 0 manc value lsb (lmanc lsb) ? (0ffset 0x2f) 3.4.5.1.6.2.18 lan 0 manc value msb (lmanc msb) ? (0ffset 0x30) 3.4.5.1.6.2.19 lan 0 receive enable 1 (lrxen1) ? (0ffset 0x31) bit name description 15:0 reserved reserved. bit name description 15:9 reserved reserved. 8 enable ipv4 address filters when set, the last 128 bits of the mipaf register are used to store four ipv4 addresses for ipv4 filtering. when cleared, these bits store a single ipv6 filter. 7 enable xsum filtering to manageability when this bit is set, only packets that pass the l3 and l4 checksum are sent to the manageability block. 6 reserved reserved. 5 enable manageability packets to host memory this bit enables the functionality of the manc2h register. when set, the packets that are specified in the manc2h registers are also forwarded to host memory if they pass the manageability filters. 4:0 reserved reserved. bit name description 15:8 receive enable byte 12 bmc smbus slave address. 7 enable bmc dedicated mac 6 reserved reserved. must be set to 1b. 5:4 notification method 00b = smbus alert. 01b = asynchronous notify. 10b = direct receive. 11b = reserved. 3 enable arp response 2 enable status reporting 1 enable receive all 0 enable receive tco
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 208 october 2010 3.4.5.1.6.2.20 lan 0 receive enable 2 (lrxen2) ? (0ffset 0x32) 3.4.5.1.6.2.21 lan 0 manc2h value (lmanc2h lsb) ? (0ffset 0x33) 3.4.5.1.6.2.22 lan 0 manc2h value (lmanc2h msb) ? (0ffset 0x34) 3.4.5.1.6.2.23 manageability decision filters- mdef0 (1) ? (0ffset 0x35) bit name description 15:8 receive enable byte 14 alert value 7:0 receive enable byte 13 interface data bit name description 15:8 reserved 7:0 host enable when set, indicates that packets routed by the manageability filters to the manageability block are also sent to the host. bit 0 corresponds to decision rule 0, etc. bit name description 15:0 reserved reserved bit name description 15:12 flex port controls the inclusion of flexible port filtering in the manageability filter decision (or section). bit 12 corresponds to flexible port 0, etc. (see also bits 11:0 of the next word). 11 port 0x26f controls the inclusion of port 0x26f filtering in the manageability filter decision (or section). 10 port 0x298 controls the inclusion of port 0x298 filtering in the manageability filter decision (or section). 9 neighbor discovery controls the inclusion of neighbor discovery filtering in the manageability filter decision (or section). 8 arp response controls the inclusion of arp response filtering in the manageability filter decision (or section). 7 arp request controls the inclusion of arp request filtering in the manageability filter decision (or section). 6 multicast controls the inclusion of multicast addresses filtering in the manageability filter decision (and section). 5 broadcast controls the inclusion of broadcast address filtering in the manageability filter decision (or section). 4 unicast controls the inclusion of unicast address filtering in the manageability filter decision (or section).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 209 3.4.5.1.6.2.24 manageability decision filters- mdef0 (2) ? (0ffset 0x36) 3.4.5.1.6.2.25 manageability decision filters- mdef1-6 (1-2) ? (0ffset 0x37-0x42) same as words 0x035 and 0x36 for mdef1-mdef6. 3.4.5.1.6.2.26 arp response ipv4 address 0 (lsb) ? (0ffset 0x43) 3.4.5.1.6.2.27 arp response ipv4 address 0 (msb) ? (0ffset 0x44) bit name description 3 ip address controls the inclusion of ip address filtering in the manageability filter decision (and section). 2 vlan controls the inclusion of vlan addresses filtering in the manageability filter decision (and section). 1 broadcast controls the inclusion of broadcast address filtering in the manageability filter decision (and section). 0 unicast controls the inclusion of unicast address filtering in the manageability filter decision (and section). bit name description 15:12 flexible tco controls the inclusion of flexible tco filtering in the manageability filter decision (or section). bit 12 corresponds to flexible tco filter 0, etc. 11 port 0x26f controls the inclusion of port 0x26f filtering in the manageability filter decision (or section). 10:0 flex port controls the inclusion of flexible port filtering in the manageability filter decision (or section). bit 11 corresponds to flexible port 0, etc. (see bits 15:12 of the previous word) bit name description 15:8 arp response ipv4 address 0, byte 1 7:0 arp response ipv4 address 0, byte 0 bit name description 15:8 arp response ipv4 address 0, byte 3 7:0 arp response ipv4 address 0, byte 2
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 210 october 2010 3.4.5.1.6.2.28 lan 0 ipv6 address 0 (lsb) (mipaf) ? (0ffset 0x45) 3.4.5.1.6.2.29 lan 0 ipv6 address 0 (msb) (mipaf) ? (0ffset 0x46) 3.4.5.1.6.2.30 lan 0 ipv6 address 0 (lsb) (mipaf) ? (0ffset 0x47) 3.4.5.1.6.2.31 lan 0 ipv6 address 0 (msb) (mipaf) ? (0ffset 0x48) 3.4.5.1.6.2.32 lan 0 ipv6 address 0 (lsb) (mipaf) ? (0ffset 0x49) bit name description 15:8 lan 0 ipv6 address 0, byte 1 7:0 lan 0 ipv6 address 0, byte 0 bit name description 15:8 lan 0 ipv6 address 0, byte 3 7:0 lan 0 ipv6 address 0, byte 2 bit name description 15:8 lan 0 ipv6 address 0, byte 5 7:0 lan 0 ipv6 address 0, byte 4 bit name description 15:8 lan 0 ipv6 address 0, byte 7 7:0 lan 0 ipv6 address 0, byte 6 bit name description 15:8 lan 0 ipv6 address 0, byte 9 7:0 lan 0 ipv6 address 0, byte 8
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 211 3.4.5.1.6.2.33 lan 0 ipv6 address 0 (msb) (mipaf) ? (0ffset 0x4a) 3.4.5.1.6.2.34 lan 0 ipv6 address 0 (lsb) (mipaf) ? (0ffset 0x4b) 3.4.5.1.6.2.35 lan 0 ipv6 address 0 (msb) (mipaf) ? (0ffset 0x4c) 3.4.5.1.6.2.36 lan 0 ipv6 address 1 (mipaf) ? (0ffset 0x4d-0x54) same structure as lan 0 ipv6 address 0. 3.4.5.1.6.2.37 lan 0 ipv6 address 2 (mipaf) ? (0ffset 0x55-0x5c) same structure as lan 0 ipv6 address 0. 3.4.5.1.7 smbus configuration structure 3.4.5.1.7.1 section header ? (0ffset 0x0) bit name description 15:8 lan 0 ipv6 address 0, byte 11 7:0 lan 0 ipv6 address 0, byte 10 bit name description 15:8 lan 0 ipv6 address 0, byte 13 7:0 lan 0 ipv6 address 0, byte 12 bit name description 15:8 lan 0 ipv6 address 0, byte 15 7:0 lan 0 ipv6 address 0, byte 14 bit name description 15:8 block crc8 7:0 block length
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 212 october 2010 3.4.5.1.7.2 smbus maximum fragment size ? (0ffset 0x01) 3.4.5.1.7.3 smbus notification timeout and flags ? (0ffset 0x02) 3.4.5.1.7.4 smbus slave addresses ? (0ffset 0x03) bit name description 15:0 smbus maximum fragment size (bytes) bit name description 15:8 smbus notification timeout (ms) 7:6 smbus connection speed 00b = slow smbus connection. 01b = reserved. 10b = reserved. 11b = reserved. 5 smbus block read command 0b = block read command is 0xc0. 1b = block read command is 0xd0. 4 smbus addressing mode 0b = single address mode. 1b = dual address mode. 3 reserved reserved. 2 disable smbus arp functionality 1 smbus arp pec 0 reserved reserved. bit name description 15:9 smbus 1 slave address dual address mode only. 8 reserved reserved. 7:1 smbus 0 slave address 0 reserved reserved.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 213 3.4.5.1.7.5 fail-over register (low word) ? (0ffset 0x04) 3.4.5.1.7.6 fail-over register (high word) ? (0ffset 0x05) 3.4.5.1.7.7 nc-si configuration (0ffset 0x06) bit name description 15:12 gratuitous arp counter 11:10 reserved reserved. 9 enable teaming fail- over on dx 8 remove promiscuous on dx 7 enable mac filtering 6 enable repeated gratuitous arp 5 reserved reserved. 4 enable preferred primary 3 preferred primary port 2 transmit port 1:0 reserved reserved. bit name description 15:8 gratuitous arp transmission interval (seconds) 7:0 link down fail-over time bit name description 15:8 reserved reserved. 7:5 package id 4:0 lan0 internal channel id
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 214 october 2010 3.4.5.1.8 flexible tco filter configuration structure 3.4.5.1.8.1 section header ? (0ffset 0x0) 3.4.5.1.8.2 flexible filter length and control ? (0ffset 0x01) 3.4.5.1.8.3 flexible filter enable mask ? (0ffset 0x02 ? 0x09) 3.4.5.1.8.4 flexible filter data ? (0ffset 0x0a ? block length) bit name description 15:8 block crc8 7:0 block length bit name description 15:8 flexible filter length (bytes) 7:5 reserved reserved. 4 last filter 3:2 filter index (0-3) 1 apply filter to lan 1 0 apply filter to lan 0 bit name description 15:0 flexible filter enable mask bit name description 15:0 flexible filter data
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 215 3.4.5.1.9 nc-si microcode download structure 3.4.5.1.9.1 patch data size ? (offset 0x0) 3.4.5.1.9.2 rx and tx code size ? (offset 0x1) 3.4.5.1.9.3 download data ? (offset 0x2 ? data size) 3.4.5.1.10 nc-si configuration structure 3.4.5.1.10.1 section header (0ffset 0x0) bit name description 15:0 data size bit name description 15:8 rx code length in dwords 7:0 tx code length in dwords bit name description 15:0 download data bit name description 15:8 block crc8 7:0 block length
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 216 october 2010 3.4.5.1.10.2 rx mode control1 (rr_ctrl[15:0]) (offset 0x1) 3.4.5.1.10.3 rx mode control2 (rr_ctrl[31:16]) (offset 0x2) 3.4.5.1.10.4 tx mode control1 (rt_ctrl[15:0]) (offset 0x3) 3.4.5.1.10.5 tx mode control2 (rt_ctrl[31:16]) (offset 0x4) bit name description 15:8 reserved reserved. should be set to 0b. 7:4 reserved reserved. 3 nc-si speed when set, the nc-si mac speed is 100 mb/s. when reset, nc-si mac speed is 10 mb/s. 2 receive without leading zeros if set, packets without leading zeros (j/k/ symbols) between txen assertion and txd the first preamble byte can be received. 1 clear rx error should be set when the rx path is stuck because of an overflow condition. 0 nc-si loopback enable when set, enables nc-si tx to rx loop. all data that is transmitted from nc-si is returned to it. no data is actually transmitted from nc-si. bit name description 15:0 reserved reserved. should be set to 0b. bit name description 15:3 reserved reserved. should be set to 0b. 2 transmit with leading zeros when set, sends leading zeros (j/k/ symbols) from crs_dv assertion to the start of preamble (phy mode). when deasserted, does not send leading zeros (mac mode). 1 clear tx error should be set when tx path is stuck because of an underflow condition. cleared by hardware when released. 0 enable tx pads when set, the nc-si tx pads are driving; otherwise, they are isolated. bit name description 15:0 reserved reserved. should be 0b.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 217 3.4.5.1.10.6 mac tx control reg1 (txcntrlreg1 (15:0]) (offset 0x5) 3.4.5.1.10.7 nc-si settings (ncsiset) (offset 0x7) 3.5 rx/tx functions 3.5.1 device data/control flows this section describes both the transmit and receive data flows for the 82598. 3.5.1.1 transmit data flow tx data flow provides a high-level description of all data/control transformation steps needed for sending ethernet packets over the wire. bit name description 15:7 reserved reserved. should be set to 0b. 6 nc-si_enable enable the mac internal nc-si mode of operation (disables external nc-si gasket). 5 two_part_deferral when set, performs the optional two part deferral. 4 append_fcs when set, computes and appends the fcs on tx frames. 3 pad_enable pad the tx frames, which are less than the minimum frame size. 2:1 reserved reserved. 0 tx_ch_en tx channel enable this bit can be used to enable the tx path of the mac. this bit is for debug only and the recommended way to enable the tx path is via the rt_uctl_ctrl .tx_enable bit. bit name description 15:2 reserved reserved. should be set to 0b. 1 nc-si out buffer strength 0b = value 0 should be configured to the nc-si out buffer strength. 1b = value 1 should be configured to the nc-si out buffer strength 0 nc-si in buffer strength 0b = value 0 should be configured to the nc-si in buffer strength. 1b = value 1 should be configured to the nc-si in buffer strength. step description 1 the host creates a descriptor ring and configures one of the 82598?s transmit queues with the address location, length, head, and tail pointers of the ring (one of 32 available tx queues).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 218 october 2010 2 the host transmits a packet provided by the tcp/ip stack. this packet arrives in one or more data buffers. 3 the host initializes the descriptor(s) that point to the data buffer(s) and adds additional control parameters that describe the needed hardware functionality. the host places that descriptor in the correct location in the appropriate tx ring. 4 the host updates the appropriate queue tail pointer (tdt). 5 the 82598?s dma senses a change of a specific tdt and as a result sends a pcie request to fetch the descriptor(s) from host memory. 6 the descriptor?s content is received in a pcie read completion and is written to the appropriate location in the descriptor queue. 7 the dma fetches the next descriptor and processes its contents. as a result, the dma sends pcie requests to fetch the packet data from system memory. 8 the packet data is being received from pcie read completions and passes through the transmit dma, which performs all programmed data manipulations on the packet data on the fly. these can include various cpu offloading tasks such as tso offloading and checksum offloads. 9 while the packet is passing through the dma, it is stored into the transmit fifo. after the entire packet is stored in the transmit fifo, it is then forwarded to the transmit switch module. 10 the transmit switch arbitrates between host and management packets and eventually forwards the packet to the mac. 11 the mac appends the l2 crc to the packet and sends the packet over the wire using a pre-configured interface. 12 when all the pcie completions for a given packet are complete, the dma updates the appropriate descriptor(s). 13 the descriptors are written back to host memory using pcie posted writes. 14 an interrupt is generated to notify the host driver that the specific packet has been read to the 82598 and the driver can then release the buffer(s).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 219 figure 3-18. transmit data flow 3.5.1.2 rx data flow rx data flow provides a high-level description of all data/control transformation steps needed for receiving ethernet packets. step description 1 the host creates a descriptor ring and configures one of the 82598?s receive queues with the address location, length, head, and tail pointers of the ring (one of 64 available rx queues) 2 the host initializes descriptor(s) that point to empty data buffer(s). the host places these descriptor(s) in the correct location at the appropriate rx ring. 3 the host updates the appropriate queue tail pointer (rdt). 4 the 82598?s dma senses a change of a specific rdt and as a result sends a pcie request to fetch the descriptor(s) from host memory. 5 the descriptor(s) content is received in a pcie read completion and is written to the appropriate location in the descriptor queue. 6 a packet enters the rx mac. 7 the mac forwards the packet to the rx filter. 8 if the packet matches the pre-programmed criteria of the rx filtering, it is forwarded to the rx fifo. 9 the receive dma fetches the next descriptor from the appropriate ring to be used for the next received packet. lan 1 lan 0 xtx mngmt fleep rxflt dma_rx mac pcie if dma_tx pmtx pmrx data interfaces control interfaces external interfaces buffer descriptor ring tdt host memory packet buffer descriptor
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 220 october 2010 figure 3-19. receive data flow 3.5.2 receive functionality packet reception consists of recognizing the presence of a packet on the wire, performing address filtering and dma queue assignment, storing the packet in the receive data fifo, transferring the data to assigned receive queues in host memory, and updating the state of a receive descriptor. step description 10 after the entire packet is placed into the rx fifo, the receive dma posts the packet data to the location indicated by the descriptor through the pcie interface. if the packet size is greater than the buffer size, more descriptors are fetched and their buffers are used for the received packet. 11 when the packet is placed into host memory, the receive dma updates all the descriptor(s) that were used by the packet data. 12 the receive dma writes back the descriptor content along with status bits that indicate the packet information including what offloads were done on that packet. 13 the 82598 initiates an interrupt to the host to indicate that a new received packet is ready in host memory. 14 the host reads the packet data and sends it to the tcp/ip stack for further processing. the host releases the associated buffer(s) and descriptor(s) once they are no longer in use.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 221 as a receive packet is accepted and processed, it is stored in on-die packet buffers before being transferred to system memory. the 82598 supports up to eight separate packet buffers. each of the active packet buffers has one or more receive descriptor queues assigned to it. the descriptor queues operate independently (but under a central arbitration scheme) to forward receive packets from their packet buffers into system memory. the following section describes how the 82598's receive descriptor queues are assigned. the following operational modes impact allocation of receive descriptor queues: ? rss (receive side scaling) ? rss shares packet processing between several processor cores by assigning packets into different descriptor queues. rss assigns each packet an rss output index. see section 3.5.2.10 for details on rss. ? virtual machine device queues (vmdq) ? vmdq shares the 82598 dma resources between more than one software entity (operating system and/or software device driver). this is done through replication of receive descriptor queues and their configuration registers. current uses of vmdq are for virtualized environments. vmdq assigns each packet a vmdq output index. see section 3.5.2.10.3 for more details on vmdq. table 3-47. supported modes for allocation of receive descriptor queues since the 82598 provides a total of 64 receive descriptor queues, a received packet is assigned a 6-bit queue index. each of rss and vmdq determines the value of some bits in the queue index: ? rss provides a 4-bit rss output index. queue allocation can use of four bits or just some lsb of it. rss assigns an rss output index equal to zero for traffic that does not go through rss. depending on the configuration of vmdq/rss, such traffic might end up in one of several queues. ? vmdq provides a 4-bit vmdq output index. queue allocation can make use of four bits or just some lsb of it. generating a 6-bit queue index from the rss and vmdq indices is defined in table 3-48 and the notes that follow it. single packet buffer rss off on vmdq off supported supported on supported supported
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 222 october 2010 table 3-48. queue assignment for received packets note: ? case 1 ? a single receive packet buffer with a single queue 0 is used for all receive traffic. ? case 2 ? a single receive packet buffer is used. rss determines one of up to 16 queues per receive packet ? case 3 ? a single receive packet buffer is used. vmdq determines one of up to 16 queues per receive packet ? case 4 ? used to separate traffic into four sets, each with 16 queues. a queue is selected as follows: ? bits 5:4 of the queue index are provided from bits 1:0 of the vmdq output index. ? bits 3:0 are provided from the rss output index. if bit 0 of the vmdq output index is 0b, then rss output index 0 is used. if bit 0 of the vmdq output index is 1b, then rss output index 1 is used. configuration registers (csrs) that control queue operation are replicated per queue (total of 64 copies of each register). each of the replicated registers corresponds to a queue such that the 6-bit queue index equals the serial number of the register (register 0 corresponds to queue 0, etc.). registers included in this category are: rdbal[63:0] and rdbah[63:0] ? rx descriptor base ? rdlen[63:0] ? rx descriptor length ? rdh[63:0] ? rx descriptor head ? rdt[63:0] ? rx descriptor tail ? rxdctl[63:0] ? receive descriptor control configuration registers (csrs) that define the functionality of descriptor queues are replicated per vmdq index to allow for separate configuration in a virtualization environment (total of 16 copies of each register). each of the replicated registers corresponds to a set of queues with the same vmdq index, such that the vmdq index of the queue identifies the serial number of the register. examples: ? case 3 above ? the vmdq index defines bits [3:0] of the queue index (all 16 copies are used, one per value of the vmdq index). therefore, queue 0 is associated with the register indexed 0, queue 1 is associated with the register indexed 1, etc. ? case 4 above ? the vmdq index defines bits [5:4] of the queue index (only 4 copies are used, one per value of the vmdq index). therefore, queues 0, 1, ?, 15 are associated with the register indexed 0, queues 16, 17, ?, 31 are associated with the register indexed 1, etc. ? else ? a single copy of the following registers is used (register # 0). configuration bit allocation [5:0] case vmdq rss vmdq rss comments 1 off off none none hardware default. queue 0 used 2 off on none 3:0 bits [5:4]=00b 3 on off 3:0 none bits [5:4]=00b 4 on on 5:4 3:0
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 223 registers included in this category are: ? dca_rxctrl[15:0] ? rx dca control ? srrctl[15:0] ? split and replication receive control ? psrtype[15:0] ? packet split receive type 3.5.2.1 packet filtering the receive packet filtering role is determining which of the incoming packets are allowed to pass to the local system, and which should be dropped. received packets can be destined to the host, to a bmc, or to both. this section describes how host filtering is done, and the interaction with management filtering. note: maximum supported received packet size is 16 kb. as shown in figure 3-20 , host filtering is done in three stages: 1. packets are filtered by l2 filters (mac address, unicast/multicast/broadcast). see section 3.5.2.1.1 for details. 2. packets are then filtered by vlan filters if a vlan tag is present. see section 3.5.2.1.2 for details. 3. packets are filtered by the manageability filters (port, ip, flex, other). refer to the intel? 82598 10 gbe controller system manageability interface application note for details. a packet is not forwarded to the host if any of the following takes place: 1. the packet does not pass l2 filters. ? the packet does not pass vlan filtering. ? the packet passes manageability filtering and the manageability filters determine that the packet should not pass to host as well. refer to the intel? 82598 10 gbe controller system manageability interface application note for details. a packet that passes receive filtering as previously described might still be dropped due to other reasons. normally, only good packets are received. these are defined as those packets with no under size error, over size error, packet error, length error and crc error detected. however, if the store- bad-packet (sbp) bit is set (fctrl.sbp), then bad packets that don't pass the filter function are stored in host memory. packet errors are indicated by error bits in the receive descriptor (rdesc.errors). it is possible to receive all packets, regardless of whether they?re bad, by setting promiscuous enables and the sbp bit. note: crc errors before the sfd are ignored. any packet must have a valid sfd in order to be recognized by the 82598 (even bad packets).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 224 october 2010 figure 3-20. rx filtering flow chart 3.5.2.1.1 l2 filtering figure 3-21 shows l2 filtering. a packet passes successfully through l2 filtering if any of the following conditions are met: 1. it is a unicast packet and promiscuous unicast filtering is enabled. 2. it is a multicast packet and promiscuous multicast filtering is enabled. 3. it is a unicast packet and it matches one of the unicast mac filters (host or manageability).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 225 4. it is a multicast packet and it matches one of the multicast filters. 5. it is a broadcast packet and broadcast accept mode (bam) is enabled. note that in this case, for manageability traffic the packet does not go through vlan filtering (vlan filtering is assumed to match). figure 3-21. l2 rx filtering flow chart
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 226 october 2010 3.5.2.1.1.1 unicast filter the entire mac address is checked against the 16 host unicast addresses and four management unicast addresses (if enabled). the 16 host unicast addresses are controlled by the host interface (the bmc must not change them). the other four addresses are dedicated to management functions and are only accessed by the bmc. the destination address of incoming packets must exactly match one of the pre- configured host address filters or the manageability address filters. these addresses can be unicast or multicast. those filters are configured through receive address low ? ral (0x05400 + 8*n[n=0..15]; rw), receive address high ? rah (0x05404 + 8*n[n=0..15]; rw), manageability mac address low ? mmal (0x5910 + 8*n[n=0..3]; rw) and manageability mac address high ? mmah (0x5914 + 8*n[n=0..3]; rw) registers. promiscuous unicast ? receive all unicasts. promiscuous unicast mode can be set/cleared only through the host interface (not by the bmc), and it is usually used when the 82598 is used as a sniffer. 3.5.2.1.1.2 multicast filter (partial) the 12-bit portion of an incoming packet multicast address must exactly match multicast filter address in order to pass the multicast filter. those 12 bits out of the 48 bits of destination address can be selected by the mo field. these entries can be configured only by the host interface and cannot be controlled by the bmc. promiscuous multicast ? receive all multicasts. promiscuous multicast mode can be set/cleared only through the host interface (not by the bmc), and it is usually used when the 82598 is used as a sniffer. 3.5.2.1.2 vlan filtering figure 3-22 shows vlan filtering. a receive packet that successfully passed l2 layer filtering is then subjected to vlan header filtering: 1. if the packet does not have a vlan header, it passes to the next filtering stage. 2. if the packet has a vlan header and it passes a valid manageability vlan filter, then is passes to the next filtering stage. 3. if the packet has a vlan header, it did not match step 2, and no host vlan filters are enabled, the packet is forwarded to the next filtering stage. 4. if the packet has a vlan header, it did not match step 2, and it matches an enabled host vlan filter, the packet is forwarded to the next filtering stage. 5. otherwise, the packet is dropped. the 82598 provides exact vlan filtering for vlan tags for host traffic and vlan tags for manageability traffic. see vlan filter table array ? vfta (0x0a000-0x0a9fc; rw) for detailed information on programming vlan filters. the bmc configures the 82598 with eight different manageability vids via the management vlan tag value [7:0] ? mavtv[7:0] registers and enables each filter in the mfval register.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 227 figure 3-22. vlan filtering 3.5.2.2 intel? 82598 10 gbe controller system manageability interface application note receive data storage the descriptor points to a memory buffer to store packet data. the size of the buffer is set using the per queue srrctl[n].bsizepacket field. receive buffer size selected by bit settings srrctl[n].bsizepacket support buffer sizes of 1 kb granularity. in addition, for advanced descriptor usage the srrctl.bsizeheader field is used to define the size of the buffers allocated to headers. the 82598 places no alignment restrictions on receive memory buffer addresses. this is desirable in situations where the receive buffer was allocated by higher layers in the networking software stack, as these higher layers might have no knowledge of a specific device's buffer alignment requirements.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 228 october 2010 although alignment is completely unrestricted, it is highly recommended that software allocate receive buffers on at least cache-line boundaries whenever possible. note: when the no-snoop enable bit is used in advanced descriptors, the buffer address should always be 16-bit aligned. 3.5.2.3 legacy receive descriptor format a receive descriptor is a data structure that contains the receive data buffer address and fields for hardware to store packet information. if srrctl[n],desctype = 000b, the 82598 uses the legacy rx descriptor as listed in table 3-49 . the shaded areas indicate fields that are modified by hardware upon packet reception (called descriptor write-back). table 3-49. legacy receive descriptor (rdesc) layout length field (16 bit offset 0) after receiving a packet for the 82598, hardware stores the packet data into the indicated buffer and writes the length, status, errors, and status fields. length covers the data written to a receive buffer including crc bytes (if any). software must read multiple descriptors to determine the complete length for packets that span multiple receive buffers. fragment checksum (16 bit offset 16) this field is used to provide the fragment checksum value. status 0 field (8 bit offset 32) status information indicates whether the descriptor has been used and whether the referenced buffer is the last one for the packet. refer to table 3-50 for the layout of the status field. error status information is shown in table 3-51 . table 3-50. receive status 0 (rdesc.status-0) layout ? pif (bit 7) ? passed in-exact filter ? ipcs (bit 6) ? ipv4 checksum calculated on packet ? l4cs (bit 5) ? l4 checksum calculated on packet 63 48 47 40 39 32 31 16 15 0 0 buffer address [63:0] 8 vlan tag errors status 0 fragment checksum 1 1. the checksum indicated here is the unadjusted 16-bit ones complement of the packet. a software assist might be required to back out appropriate information prior to sending it up to upper software layers. the fragment checksum is always reported in the first descriptor (even in the case of multi-descriptor packets). length 7 6 5 4 3 2 1 0 pif ipcs l4cs udpcs vp reserved eop dd
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 229 ? udpcs (bit 4) ? udp/tcp checksum calculated on packet ? vp (bit 3) ? packet is 802.1q (matched vet); indicates strip vlan in 802.1q packet ? reserved (bit 2) ? reserved ? eop (bit 1) ? end of packet ? dd (bit 0) ? descriptor done eop, dd packets that exceed the receive buffer size span multiple receive buffers. eop indicates whether this is the last buffer for an incoming packet. dd indicates whether hardware is done with the descriptor. when set along with eop, the received packet is complete in main memory. software can determine buffer usage by setting the status byte to zero before making the descriptor available to hardware, and checking it for non-zero content at a later time. for multi-descriptor packets, packet status is provided in the final descriptor of the packet (eop set). if eop is not set for a descriptor, only the address, length, and dd bits are valid. vp the vp field indicates whether the incoming packet's type matches vet (if the packet is a vlan (802.1q) type). it's set if the packet type matches vet and vlnctrl.vme is set. it also indicates that vlan has been stripped in the 802.1q packet. for a further description of 802.1q vlans please see section 3.5.5 . ipcs, l4cs, udpcs: the meaning of these bits is shown in the following table: see section 3.5.2.12 for a description of supported packet types for receive checksum offloading. ipv6 packets do not have the ipcs bit set, but might have the l4cs bit set if the 82598 recognized the tcp or udp packet. pif hardware supplies the pif field to expedite software processing of packets. software must examine any packet with pif set to determine whether to accept the packet. if pif is clear, then the packet is known to be for this station, so software need not look at the packet contents. packets passing only the multicast vector (mta) but not any of the mac address exact filters (rah, ral) has pif set. error field (8 bit offset 40) most error information appears only when the sbp bit (fctrl.sbp) is set and a bad packet is received. refer to table 3-51 for a definition of the possible errors and their bit positions. l4cs udpcs ipcs functionality 0b 0b 0b hardware does not provide checksum offload. special case: hardware does not provide udp checksum offload for ipv4 packet with udp checksum = 0b. 1b 0b 1b/0b hardware provides ipv4 checksum offload if ipcs active and tcp checksum offload. pass/fail indication is provided in the error field ? ipe and tcpe. see pkttype table for supported packet types. 1b 1b 1b/0b hardware provides ipv4 checksum offload if ipcs is active along with udp checksum offload. pass/fail indication is provided in the error field ? ipe and tcpe. see pkttype table for supported packet types.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 230 october 2010 table 3-51. receive errors (rdesc.errors) layout ? ipe (bit 7) ? ipv4 checksum error ? tcpe (bit 6) ? tcp/udp checksum error ? use (bit 5) ? undersize error ? undersized packet received ? ose (bit 4) ? oversize error ? oversized packet received ? pe (bit 3) ? packet error ? illegal symbol or error symbol in the middle of a received packet ? reserved (bit 2) ? reserved ? le (bit 1) ? length error ? ce (bit 0) ? crc error the ip and tcp checksum error bits from table 3-51 are valid only when the ipv4 or tcp/udp checksum(s) is performed on the received packet as indicated via ipcs and l4cs. these, along with the other error bits, are valid only when the eop and dd bits are set in the descriptor. note: receive checksum errors have no effect on packet filtering. vlan tag field (16 bit offset 48) hardware stores additional information in the receive descriptor for 802.1q packets. if the packet type is 802.1q (determined when a packet matches vet and vlnctrl.vme = 1b), then the vlan tag field records the vlan information and the four-byte vlan information is stripped from the packet data storage. otherwise, the vlan tag field contains 0x0000. table 3-52. vlan tag field layout (for 802.1q packet) 3.5.2.4 advanced receive descriptors table 3-53 lists the receive descriptor. table 3-53. descriptor read format 7 6 5 4 3 2 1 0 ipe tcpe use ose pe reserved le ce 15 13 12 11 0 pri cfi vlan 63 1 0 0 packet buffer address [63:1] a0/ nse 8 header buffer address [63:1] dd
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 231 packet buffer address (64) the physical address of the packet buffer. the lowest bit is either a0 (lsb of address) or nse (no snoop enable), depending on bit dca_rxctrl.rxdatawritensen of the relevant queue. header buffer address (64) the physical address of the header buffer. the lowest bit is dd (descriptor done). note: the 82598 does not support null descriptors, in which a packet or header address is equal to zero. when software sets the nse (no-snoop) bit, the 82598 places the received packet associated with this descriptor in memory at the packet buffer address with the no-snoop bit set in the pcie attribute fields. nse does not affect the data written to the header buffer address. when a packet spans more than one descriptor, the header buffer address is not used for the second, third, etc. descriptors; only the packet buffer address is used in this case. no-snoop is enabled for packet buffers that the software device driver knows have not been touched by the processor since the last time they were used, so the data cannot be in the processor cache and snoop is always a miss. avoiding these snoop misses improves system performance. no-snoop is particularly useful when the data movement engine is moving the data from the packet buffer into application buffers and the software device driver is using the information in the header buffer for operation with the packet. note: when no-snoop enable is used, relaxed ordering should also be enabled with ctrl_ext.ro_dis. note that when the 82598 writes back the descriptors, it uses the descriptor format shown in table 3-54 . the srrctl[n].desctype must be set to a value other than 000b for the 82598 to write back the special descriptors. table 3-54. descriptor write-back format light blue fields are mutually exclusive by rxcsum.pcsd. packet type (12) ? rsv(11-8) ? reserved ? nfs (bit 7) ? nfs header present ? sctp (bit 6) ? sctp header present ? udp (bit 5) ? udp header present ? tcp (bit 4) ? tcp header present 63 60 59 56 55 52 51 48 47 44 43 40 39 36 35 32 31 30:21 20 16 15:4 3:0 0 rss hash value sph hdr_buf_len rsv packet type rss type fragment checksum ip identification 8 vlan tag pkt_buf_length extended error extended status 63 48 47 32 31 20 19 0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 232 october 2010 ? ipv6e (bit 3) ? ipv6 header includes extensions ? ipv6 (bit 2) ? ipv6 header present ? ipv4e (bit1) ? ipv4 header includes extensions ? ipv4 (bit 0) ? ipv4 header present note: udp, tcp and ipv6 indication are not set in an ipv4 fragmented packet. rss type (8) the 82598 must identify the packet type and then choose the appropriate rss hash function to be used on the packet. the rss type reports the packet type that was used for the rss hash function. rsv(5) reserved. split header (11) ? sph(bit 9) ? when set to 1b, indicates that the hardware has found the length of the header. if set to 0b, the header buffer length field is ignored. ? hdr_buf_len(bit 9:0) ? the length (bytes) of the header as parsed by the 82598. in header split mode (sph set to 1b), this field also reflects the size of the header that was actually stored in the buffer. however, in header replication mode (sph is also set in this mode), this does not reflect the size of the data actually stored in the header buffer. this is because the 82598 fills the buffer up to the size configured by srrctl[n].bsizeheader that might be larger than the header size reported here. note: packets that have headers larger than 1 kb are not split. packet types supported by the packet split: the 82598 provides header split for the packet types that follow. other packet types are posted sequentially in the host packet buffer. packet type description 0x0 no hash computation done for this packet 0x1 hash_tcp_ipv4 0x2 hash_ipv4 0x3 hash_tcp_ipv6 0x4 hash_ipv6_ex 0x5 hash_ipv6 0x6 hash_tcp_ipv6_ex 0x7 hash_udp_ipv4 0x8 hash_udp_ipv6 0x9 hash_udp_ipv6_ex 0xa7 ? 0xf reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 233 each line in the following table has an enable bit in the psrtype register. when one of the bits is set, the corresponding packet type is split. note: header of fragmented ipv6 packet is defined until the fragmented extension header. packet type description header split 0x0 header includes mac, (vlan/snap) only. no. 0x1 header includes mac, (vlan/snap), ipv4, only split header after l3 if fragmented packets. 0x2 header includes mac, (vlan/snap), ipv4, tcp, only split header after l4 if not fragmented, otherwise treat as packet type 1. 0x3 header includes mac, (vlan/snap), ipv4, udp only split header after l4 if not fragmented, otherwise treat as packet type 1. 0x4 header includes mac (vlan/snap), ipv4, ipv6, only split header after l3 if ipv6 indicates a fragmented packet or treat as packet type 0x1 if ipv4 header is fragmented. 0x5 header includes mac (vlan/snap), ipv4, ipv6,tcp, only split header after l4 if ipv4 not fragmented and if ipv6 does not include fragment extension header, otherwise treat as packet type 4. 0x6 header includes mac (vlan/snap), ipv4, ipv6, udp only split header after l4 if ipv4 not fragmented and if ipv6 does not include fragment extension header, otherwise treat as packet type 4. 0x7 header includes mac (vlan/snap), ipv6, only split header after l3 if fragmented packets. 0x8 header includes mac (vlan/snap), ipv6, tcp, only split header after l4 if ipv6 does not include fragment extension header, otherwise treat as packet type 7. 0x9 header includes mac (vlan/snap), ipv6, udp only split header after l4 if ipv6 does not include fragment extension header, otherwise treat as packet type 7. 0xa reserved 0xb header includes mac, (vlan/snap) ipv4, tcp, nfs, only split header after l5 if not fragmented, otherwise treat as packet type 1. 0xc header includes mac, (vlan/snap), ipv4, udp, nfs, only split header after l5 if not fragmented, otherwise treat as packet type 1. 0xd reserved 0xe header includes mac (vlan/snap), ipv4, ipv6, tcp,nfs, only split header after l5 if ipv4 not fragmented and if ipv6 does not include fragment extension header, otherwise treat as packet type 4. 0xf header includes mac (vlan/snap), ipv4, ipv6, udp, nfs, only split header after l5 if ipv4 not fragmented and if ipv6 does not include fragment extension header, otherwise treat as packet type 4. 0x10 reserved 0x11 header includes mac (vlan/snap), ipv6, tcp, nfs, only split header after l5 if ipv6 does not include fragment extension header, otherwise treat as packet type 7. 0x12 header includes mac (vlan/snap), ipv6, udp, nfs, only split header after l5 if ipv6 does not include fragment extension header, otherwise treat as packet type 7.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 234 october 2010 fragment checksum (16) this field is used to provide the fragment checksum value for fragmented udp packets. the fragment checksum field can be used to accelerate udp checksum verification by the host processor. this operation is enabled by the rxcsum.ippcse bit. this field is mutually exclusive with the rss hash. it is enabled when the rxcsum.pcsd bit is cleared. rss hash value (32) rss hash value. extended status (20) ? reserved (bits 19:12) ? reserved ? dynint (bit 11) ? packet caused immediate interrupt via dynamic interrupt moderation ? udpv (bit 10) ? valid udp checksum ? reserved (bit 9) ? reserved ? crcv (bit 8) ? speculative crc valid ? pif (bit 7) ? passed inexact filter ? ipcs (bit 6) ? ipv4 checksum calculated on packet ? l4cs (bit 5) ? tcp checksum calculated on packet ? udpcs (bit 4) ? udp checksum calculated on packet ? vp (bit 3) ? packet is 802.1q (matched vet). indicates strip vlan field. ? reserved (bit 2) ? reserved ? eop (bit 1) ? end of packet ? dd (bit 0) ? descriptor done dynint indicates that this packet caused an immediate interrupt via dynamic interrupt moderation. crcv hardware speculatively found a valid crc-32. it is up to the software device driver to determine the validity of this indication of a correct crc-32. pif hardware supplies the pif field to expedite software processing of packets. software must examine any packet with pif set to determine whether to accept the packet. if pif is clear, then the packet is known to be for this station so software need not look at the packet contents. in general, packets passing only the multicast vector (mta) but not any of the mac address exact filters (rah, ral) has pif set. there are considerations that has pif set: ? in non-promiscuous multicast mode (mcstctrl.mpe = 0b) or ignore broadcast mode (fctrl.bam = 0b), the pif bit is set if a packet matches inexact filter (or imperfect ? mta) but not matching any exact (rah, ral) filter. eop packets that exceed the receive buffer size span multiple receive buffers. eop indicates whether this is the last buffer for an incoming packet.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 235 dd indicates whether hardware is finished with the descriptor. when set along with eop , the received packet is complete in main memory. software can determine buffer usage by setting the status byte dd bit to 0b before making the descriptor available to hardware, and checking it for non-zero content at a later time. for multi-descriptor packets, packet status is provided in the final descriptor of the packet ( eop set). if eop is not set for a descriptor, only the address , length , and dd bits are valid. vp the vp field indicates whether the incoming packet's type matches vet and the vlan field is stripped (if the packet is a vlan (802.1q) type). it's set if the packet type matches vet and vlnctrl.vme is set. ipcs, l4cs, udpcs: bit descriptions are listed in the following table: table 3-55. ipcs, l4cs, udpcs see section 3.5.2.12 for a description of supported packet types for receive checksum offloading. ipv6 packets do not have the ipcs bit set, but might have the l4cs bit set if the 82598 recognized the tcp or udp packet. extended error field extended error (12) ? ipe (bit 11) ? ipv4 checksum error ? tcpe (bit 10) ? tcp/udp checksum error ? use (bit 9) ? undersize error ? undersized packet received ? ose (bit 8) ? oversize error ? oversized packet received ? pe (bit 7) ? packet error ? illegal symbol or error symbol in the middle of a received packet ? reserved (bit 6) ? reserved ? le (bit 5) ? length error ? ce (bit 4) ? crc error ? hbo (bit 3) ? header buffer overflow (the header is bigger than the header buffer) ? reserved (bits 2:0) ? reserved l4cs udpcs ipcs functionality 0b 0b 0b hardware does not provide checksum offload. special case: hardware does not provide udp checksum offload for ipv4 packet with udp checksum = 0b. 1b 0b 1b/0b hardware provides ipv4 checksum offload if ipcs active and tcp checksum offload. pass/fail indication is provided in the error field ? ipe and tcpe. see pkttype table for supported packet types. 1b 1b 1b/0b hardware provides ipv4 checksum offload if ipcs is active along with udp checksum offload. pass/fail indication is provided in the error field ? ipe and tcpe. see pkttype table for supported packet types.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 236 october 2010 rxe indicates that a data error occurred during the packet reception. a data error refers to the reception of a /fe/ code from the xgmii interface which eventually causes crc error detection ( ce bit). this bit is valid only when the eop and dd bits are set and are not set in descriptors unless fctrl.sbp (store- bad-packets) is set. the rxe bit can also be set if a parity error was discovered in the packet buffer while reading this packet. in this case, rxe can be set even if fctrl.sbp is not set. ipe indicates that the ipv4 header checksum is incorrect. tcpe indicates that the tcp or udp checksum is incorrect. the ip and tcp checksum error bits are valid only when the ipv4 or tcp/udp checksum(s) is performed on the received packet as indicated via ipcs and l4cs. these, along with the other error bits are valid only when the eop and dd bits are set in the descriptor. note: receive checksum errors have no effect on packet filtering. ce indicates an ethernet crc error was detected. this bit is valid only when the eop and dd bits are set and are not set in descriptors unless fctrl.sbp (store-bad-packets) is set. le indicates an ethernet l2 length error was detected. this bit is valid only when the eop and dd bits are set and are not set in descriptors unless fctrl.sbp (store-bad-packets) is set. hbo (header buffer overflow) 1. in header split mode, when srrctl bsizeheader is smaller than hdr_buf_len, then hbo is set to 1b. in this case, the header is not split. instead, the header resides within the host packet buffer. if sph is set, then the hdr_buf_len field is still valid and equal to the calculated size of the header. however, the header is not copied into the header buffer. 2. hbo should be ignored each time sph is not set to 1b. note: most error information appears only when the sbp bit (fctrl.sbp) is set and a bad packet is received. pkt_buf_length (16) number of bytes exists in the host packet buffer. the length covers the data written to a receive buffer including crc bytes (if any). software must read multiple descriptors to determine the complete length for packets that span multiple receive buffers. if srrctl.desc_type = 4 (advanced descriptor header replication large packet only) and the total packet length is smaller than the size of the header buffer (no replication is done), this field still reflects the size of the packet, although no data is written to the data buffer. if srrctl.desc_type = 2 (advanced descriptor header splitting) and the buffer is not split because the header is bigger than the allocated header buffer, this field reflects the size of the data written to the data buffer (header + data). vlan tag (16) hardware stores additional information in the receive descriptor for 802.1q packets. if the packet type is 802.1q (determined when a packet matches vet and vlnctrl.vme=1b), then the vlan tag field records the vlan information and the four-byte vlan information is stripped from the packet data storage. otherwise, the vlan tag field contains 0x0000.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 237 table 3-56. vlan tag field layout (for 802.1q packet) priority and cfi are part of 803.1q specifications. 3.5.2.5 receive udp fragmentation checksum the 82598 might provide receive fragmented udp checksum offload. the following setup should be made to enable this mode: ? the rxcsum.pcsd bit should be cleared. the fragment checksum and ip identification fields are mutually exclusive with the rss hash. when the pcsd bit is cleared, the fragment checksum and ip identification are active, instead of rss hash. ? the rxcsum.ippcse bit should be set. this field enables the ip payload checksum enable that is designed for the fragmented udp checksum. the following table lists the outcome descriptor fields for the following incoming packets types. table 3-57. descriptor fields for incoming packet types note: when the software device driver computes the 16-bit 1?s complement sum on the incoming packets of the udp fragments, it should expect a value of 0xffff. 3.5.2.6 receive descriptor fetching the fetching algorithm attempts to make the best use of pcie bandwidth by fetching a cache-line (or more) descriptor with each burst. the following sections briefly describe the descriptor fetch algorithm and the software control provided. 15 13 12 11 0 priority cfi vlan incoming packet type fragment checksum udpv udpcs/l4cs non ipv4 packet 0b 0b 0b/0b for udp 0b/1b for tcp for ipv6 not fragmented packet else 0b/0b non fragmented ipv4 packet same as above 0b depends on transport header udp: 1b/1b tcp: 0b/1b fragmented ipv4, when not first fragment the unadjusted 1?s complement checksum of the ip payload 0b 1b/0b fragmented ipv4 with protocol = udp, first fragment (udp protocol present) same as above 1b if the udp header checksum is valid (not 0b) 1b/0b
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 238 october 2010 when the on-chip buffer is empty, a fetch happens as soon as any descriptors are made available (host writes to the tail pointer). when the on-chip buffer is nearly empty (rxdctl.pthresh), a prefetch is performed each time enough valid descriptors (rxdctl.hthresh) are available in host memory and no other pcie activity of greater priority is pending (descriptor fetches and write-backs or packet data transfers). when the number of descriptors in host memory is greater than the available on-chip descriptor storage, the 82598 might elect to perform a fetch that is not a multiple of cache line size. the hardware performs this non-aligned fetch if doing so results in the next descriptor fetch being aligned on a cache line boundary. this enables the descriptor fetch mechanism to be most efficient in the cases where it has fallen behind software. note: the 82598 never fetches descriptors beyond the descriptor tail pointer. 3.5.2.7 receive descriptor write-back processors have cache line sizes that are larger than the receive descriptor size (16 bytes). consequently, writing back descriptor information for each received packet would cause expensive partial cache line updates. a receive descriptor packing mechanism minimizes the occurrence of partial line write backs. to maximize memory efficiency, receive descriptors are packed together and written as a cache line whenever possible. descriptor write backs accumulate and are opportunistically written out in cache line-oriented chunks, under the following scenarios: ? rxdctl.wthresh descriptors have been used (the specified maximum threshold of unwritten used descriptors has been reached) ? the receive timer expires (itr) ? dynamic interrupt moderation (immediate bit indicating itr should be overwritten) when the number of descriptors specified by rxdctl.wthresh have been used, they are written back, regardless of cache line alignment. it is therefore recommended that wthresh be a multiple of cache line size. when the receive timer (itr) expires, all used descriptors are forced to be written back prior to initiating the interrupt, for consistency. when the 82598 does a partial cache line write-back, it attempts to recover to cache-line alignment on the next write-back. note: software can determine if a descriptor has been used for packet reception by checking the dd bit of the descriptor written back. software should not use the receive head register as an indication to the descriptor usage by hardware. 3.5.2.8 receive descriptor queue structure figure 3-23 shows the structure of each of the receive descriptor rings with each ring using a contiguous memory space. hardware maintains internal circular queues of 64 descriptors (per queue) to hold the descriptors that were fetched from the software ring. the hardware writes back used descriptors just prior to advancing the head pointer(s). head and tail pointers wrap back to base when size descriptors have been processed.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 239 figure 3-23. receive descriptor ring structure software inserts receive descriptors by advancing the tail pointer(s) to refer to the address of the entry just beyond the last valid descriptor. this is accomplished by writing the descriptor tail register(s) with the offset of the entry beyond the last valid descriptor. the hardware adjusts its internal tail pointer(s) accordingly. as packets arrive, they are stored in memory and the head pointer(s) is incremented by hardware. when the head pointer(s) is equal to the tail pointer(s), the queue(s) is empty. hardware stops storing packets in system memory until software advances the tail pointer(s), making more receive buffers available. the receive descriptor head and tail pointers reference to16-byte blocks of memory. shaded boxes in the figure represent descriptors that have stored incoming packets but have not yet been recognized by software. software can determine if a receive buffer is valid by reading descriptors in memory rather than by io reads. any descriptor with a non-zero status byte has been processed by the hardware, and is ready to be handled by the software. note: the head pointer points to the next descriptor that is written back. at the completion of the descriptor write-back operation, this pointer is incremented by the number of descriptors written back. hardware owns all descriptors between [head .. tail]. any descriptor not in this range is owned by software. the receive descriptor rings are described by the following registers:
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 240 october 2010 ? receive descriptor base address registers (rdba) ? this register indicates the start of the descriptor ring buffer; this 64-bit address is aligned on a 16 byte boundary and is stored in two consecutive 32-bit registers. hardware ignores the lower four bits. ? receive descriptor length registers (rdlen) ? this register determines the number of bytes allocated to the circular buffer. this value must be a multiple of 128 (the maximum cache line size). since each descriptor is 16 bytes in length, the total number of receive descriptors is always a multiple of eight. ? receive descriptor head registers (rdh) ? this register holds a value that is an offset from the base and indicates the in-progress descriptor. there can be up to 32k-8 descriptors in the circular buffer. hardware maintains a shadow copy that includes those descriptors completed but not yet stored in memory. ? receive descriptor tail registers (rdt) ? this register holds a value that is an offset from the base and identifies the location beyond the last descriptor hardware can process. this is the location where software writes the first new descriptor. if software statically allocates buffers, and uses a memory read to check for completed descriptors, it needs to zero the status byte in the descriptor to make it ready for re-use by hardware. this is not a hardware requirement, but is necessary for performing an in-memory scan. all registers controlling the descriptor rings behavior should be set before receive is enabled, apart from the tail registers which are used during the regular flow of data. 3.5.2.9 header splitting and replication 3.5.2.9.1 purpose this feature consists of splitting or replicating packet's header to a different memory space. this helps the host to fetch headers only for processing: headers are replicated through a regular snoop transaction, in order to be processed by the host cpu. it is recommended to perform this transaction with the dca feature enabled (see section 3.5.6 ). the packet (header + payload) is stored in memory through a (optionally) no-snoop transaction. later, the data movement engine moves the payload from the driver space to the application memory. the 82598 supports header splitting in several modes: ? legacy mode: legacy descriptors are used; headers and payloads are not split ? advanced mode, no split: advanced descriptors are in use; header and payload are not split ? advanced mode, split: advanced descriptors are in use; header and payload are split to different buffers ? advanced mode, split: always use header buffer: advanced descriptors are in use; header and payload are split to different buffers. if no split is done, the first part of the packet is stored in the header buffer ? advanced mode, replication: advanced descriptors are in use; header is replicated in a separate buffer, and also in the payload buffer. ? advanced mode, replication, conditioned by packet size: advanced descriptors are in use; replication is performed only if the packet is larger than the header buffer size. 3.5.2.9.2 description in figure 3-24 , the header splitting with header replication is described.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 241 figure 3-24. header splitting with replicated header the physical address of each buffer is written in the buffer addresses fields: ? the packet buffer address includes the address of the buffer assigned to the replicated packet, including header and data payload portions of the received packet. in case of split header, only the payload is included. ? the header buffer address includes the address of the buffer that contains the header information. the receive dma module stores the header portion of the received packets into this buffer. the sizes of these buffers are statically defined in the srrctl[n] registers: ? the bsizepacket field defines the size of the buffer for the received packet. ? the bsizeheader field defines the size of the buffer for the received header. if header split or header replication are enabled, this field must be configured to a non-zero value. the amount of data written into the header buffer is different in header split and header replication modes: ? header split ? the 82598 only writes the header portion into the header buffer. the header size is determined by the options enabled in the psrtype registers. ? header replication ? the 82598 writes beyond the header up to the full size of the header buffer (or to the size of the packet, if smaller). the 82598 uses the packet replication or splitting feature when the srrctl[n].desctype > one. when header split or header replication is selected, the packet is split (or replicated) only on selected types of packets. a bit exists for each option in psrtype[n] registers, so several options can be used in conjunction. if one or more bits are set, the splitting (or replication) is performed for the corresponding packet type. see section 3.5.2.4 for details on the possible headers type supported. the following table lists the behavior of the 82598 in the different modes:
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 242 october 2010 table 3-58. mode behavior for 82598 note: if srrctl#.nse is set, all buffers' addresses in a packet descriptor must be word aligned. packet header cannot span across buffers, therefore, the size of the header buffer must be larger than any expected header size. otherwise only the part of the header fitting the header buffer is replicated. if header split mode (srrctl.desctype = 010b), a packet with a header larger than the header buffer is not split. 3.5.2.10 receive-side scaling (rss) rss is a mechanism to post each received packet into one of several descriptor queues. software potentially assigns each queue to a different processor, therefore sharing the load of packet processing among several processors. desctype condition sph hbo pkt_len hdr_len copy split 1. header can't be decoded 0b 0b min (packet length, buffer size) n/a header + payload ? packet buffer 2. header <= bsizeheader 1b 0b min (payload length, buffer size) 3 header size header ? header buffer payload ? packet buffer 3. header > bsizeheader 1b 1b min (packet length, buffer size) header size 6 header + payload ? packet buffer split ? always use header buffer 1. packet length <= bsizeheader 0b 0b 0b packet length header + payload ? header buffer 2. header can?t be decoded (packet length > bsizeheader) 0b 0b min (packet length ? bsizeheader, data buffer size) bsizeheader header + payload ? header + packet buffers 4 3. header <= bsizeheader 1b 0b min (payload length, data buffer size) header size header ? header buffer payload ? packet buffer 4. header > bsizeheader 1b 1b min (packet length ? bsizeheader, data buffer size) header size 6 header + payload ? header + packet buffer replicate 1. header + payload <= bsizeheader 0b/ 1b 0b packet length header size, n/a 5 header + payload ? header buffer 2. header + payload > bsizeheader 0b/ 1b 0b/ 1b 2 min (packet length, buffer size) header size, n/a 5 (header + payload)(partial 1 ) ? header buffer header + payload ? packet buffer notes: 1. partial means up to bsizeheader 2. hbo is 1b if the header size is bigger than bsizeheader and zero otherwise. 3. in a header only packet (such as tcp ack packet), the pkt_len is zero. 4. if the packet spans more than one descriptor, only the header buffer of the first descriptor is used. 5. if sph = 0b, then the header size is not relevant. in any case, the hdr_len doesn't reflect the actual data size stored in the header buffer. 6. the hdr_len doesn't reflect the actual data size stored in the header buffer. it reflects the header size determined by the parser.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 243 as described in section 3.5.2 , the 82598 uses rss as one ingredient in its packet assignment policy (the other is vmdq). the rss output is a 4-bit index or a pair of 4-bit indices. the 82598's global assignment uses these bits (or only some of the lsbs) as part of the queue policy. rss is enabled in the mrqc register. rss status field in the descriptor write-back is enabled when the rxcsum.pcsd bit is set (fragment checksum is disabled). rss is therefore mutually exclusive with udp fragmentation. also, support for rss is not provided when legacy receive descriptor format is used. when rss is enabled, the 82598 provides software with the following information, required by microsoft* rss or provided for software device driver assistance: ? a dword result of the microsoft* rss hash function, to be used by the stack for flow classification, is written into the receive packet descriptor (required by microsoft* rss). ? a 4-bit rss type field conveys the hash function used for the specific packet (required by microsoft* rss). figure 3-25 shows the process of computing an rss output: 1. the receive packet is parsed into the header fields used by the hash operation (ip addresses, tcp port, etc.) 2. a hash calculation is performed. the 82598 supports a single hash function, as defined by microsoft* rss. the 82598 therefore does not indicate to the software device driver which hash function is used. the 32-bit result is fed into the packet receive descriptor. 3. the seven lsbs of the hash result are used as an index into a 128-entry indirection table. each entry provides a 4-bit rss output index or a pair of 4 bit indices. when rss is disabled, packets are assigned an rss output index = 0b. system software might enable or disable rss at any time. while disabled, system software might update the contents of any of the rss-related registers. when multiple requests queues are enabled in rss mode, un-decodable packets are assigned an rss output index = 0b. the 32-bit tag (normally a result of the hash function) equals 0b.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 244 october 2010 figure 3-25. rss block diagram 3.5.2.10.1 rss hash function section 3.5.2.10.1 provides a verification suite used to validate that the hash function is computed according to microsoft* nomenclature. the 82598 hash function follows the microsoft* definition. a single hash function is defined with several variations for the following cases: ? tcpipv4 ? the 82598 parses the packet to identify an ipv4 packet containing a tcp segment. if the packet is not an ipv4 packet containing a tcp segment, receive-side-scaling is not done for the packet. ? ipv4 ? the 82598 parses the packet to identify an ipv4 packet. if the packet is not an ipv4 packet, rss is not done for the packet. ? tcpipv6 ? the 82598 parses the packet to identify an ipv6 packet containing a tcp segment. if the packet is not an ipv6 packet containing a tcp segment, rss is not done for the packet.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 245 ? tcpipv6ex ? the 82598 parses the packet to identify an ipv6 packet containing a tcp segment with extensions. if the packet is not an ipv6 packet containing a tcp segment, rss is not done for the packet. extension headers should be parsed for a home-address-option field (for source address) or the routing-header-type-2 field (for destination address). ? ipv6 ? the 82598 parses the packet to identify an ipv6 packet. if the packet is not an ipv6 packet, rss is not done for the packet. the following additional cases are not part of the microsoft* rss specification: ? udpipv4 ? the 82598 parses the packet to identify a packet with udp over ipv4 ? udpipv6 ? the 82598 parses the packet to identify a packet with udp over ipv6 ? udpipv6ex ? the 82598 parses the packet to identify a packet with udp over ipv6 with extensions a packet is identified as containing a tcp segment if all of the following conditions are met: ? the transport layer protocol is tcp (not udp, icmp, igmp, etc.) ? the tcp segment can be parsed (ip options can be parsed, packet not encrypted) ? the packet is not fragmented (even if the fragment contains a complete tcp header) bits[31:16] of the multiple receive queues command (mrqc) register enable each of the above hash function variations (several can be set at a given time). if several functions are enabled at the same time, priority is defined as follows (skip functions that are not enabled): ipv4 packet: 1. use the tcpipv4 function. 2. use ipv4_udp function. 3. use the ipv4 function. ipv6 packet: 1. if tcpipv6ex is enabled, use the tcpipv6ex function or if tcpipv6 is enabled, use the tcpipv6 function. 2. if udpipv6ex is enabled, use udpipv6ex function or if updipv6 is enabled, use udpipv6 function. the following combinations are currently supported: ? any combination of ipv4, tcpipv4, and udpipv4. ? and/or ? any combination of either ipv6, tcpipv6, and udpipv6, tcpipv6ex, and udpipv6ex. when a packet cannot be parsed by the previously stated rules, it is assigned an rss output index = zero. the 32-bit tag (normally a result of the hash function) equals zero. the 32-bit result of the hash computation is written into the packet descriptor and also provides an index into the indirection table. the following notation is used to describe the following hash functions: ? ordering is little endian in both bytes and bits. for example, the ip address 161.142.100.80 translates into 0xa18e6450 in the signature ? a " ^ " denotes bit-wise xor operation of same-width vectors ? @x-y denotes bytes x through y (including both of them) of the incoming packet, where byte 0 is the first byte of the ip header. in other words, all byte-offsets as offsets into a packet where the
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 246 october 2010 framing layer header has been stripped out. therefore, the source ipv4 address is referred to as @12-15, while the destination v4 address is referred to as @16-19. ? @x-y, @v-w denotes concatenation of bytes x-y, followed by bytes v-w, preserving the order in which they occurred in the packet. all hash function variations (ipv4 and ipv6) follow the same general structure. specific details for each variation are described in the following section. the hash uses a random secret key of length 320 bits (40 bytes); the key is generally supplied through the rss random key (rssrk) register. the algorithm works by examining each bit of the hash input from left to right. intel?s nomenclature defines left and right for a byte-array as follows: given an array k with kb, intel?s nomenclature assumes that the array is laid out as follows: k[0] k[1] k[2] ? k[k-1] k[0] is the left-most byte, and the msb of k[0] is the left-most bit. k[k-1] is the right-most byte, and the lsb of k[k-1] is the right-most bit. computehash(input[], n) for hash-input input[] of length n bytes (8n bits) and a random secret key k of 320 bits result = 0; for each bit b in input[] { if (b == 1) then result ^= (left-most 32 bits of k); shift k left 1 bit position; } return result; the following four pseudo-code examples are intended to help clarify exactly how the hash is to be performed in four cases, ipv4 with and without ability to parse the tcp header, and ipv6 with an without a tcp header. 3.5.2.10.1.1 hash for ipv4 with tcp concatenate sourceaddress, destinationaddress, sourceport, destinationport into one single byte- array, preserving the order in which they occurred in the packet: input[12] = @12-15, @16-19, @20- 21, @22-23. result = computehash(input, 12); 3.5.2.10.1.2 hash for ipv4 with udp concatenate sourceaddress, destinationaddress, sourceport, destinationport into one single byte- array, preserving the order in which they occurred in the packet: input[12] = @12-15, @16-19, @20- 21, @22-23. result = computehash(input, 12); 3.5.2.10.1.3 hash for ipv4 without tcp concatenate sourceaddress and destinationaddress into one single byte-array input[8] = @12-15, @16-19 result = computehash(input, 8) 3.5.2.10.1.4 hash for ipv6 with tcp similar to above: input[36] = @8-23, @24-39, @40-41, @42-43 result = computehash(input, 36)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 247 3.5.2.10.1.5 hash for ipv6 with udp similar to above: input[36] = @8-23, @24-39, @40-41, @42-43 result = computehash(input, 36) 3.5.2.10.1.6 hash for ipv6 without tcp input[32] = @8-23, @24-39 result = computehash(input, 32) 3.5.2.10.2 indirection table the indirection table is a 128-entry structure, indexed by the seven lsbs of the hash function output. each entry of the table contains the following: ? bits [3:0] ? rss output index 0 ? bits [7:4] ? rss output index 1 (optional) system software can update the indirection table during run time. such updates of the table are not synchronized with the arrival time of received packets. therefore, it is not guaranteed that a table update takes effect on a specific packet boundary. 3.5.2.10.3 rss verification suite assume that the random key byte-stream is: 0x6d, 0x5a, 0x56, 0xda, 0x25, 0x5b, 0x0e, 0xc2, 0x41, 0x67, 0x25, 0x3d, 0x43, 0xa3, 0x8f, 0xb0, 0xd0, 0xca, 0x2b, 0xcb, 0xae, 0x7b, 0x30, 0xb4, 0x77, 0xcb, 0x2d, 0xa3, 0x80, 0x30, 0xf2, 0x0c, 0x6a, 0x42, 0xb7, 0x3b, 0xbe, 0xac, 0x01, 0xfa ipv4 ipv6 the ipv6 address tuples are only for verification purposes, and may not make sense as a tuple. destination address/port source address/port ipv4 only ipv4 with tcp 161.142.100.80:1766 66.9.149.187:2794 0x323e8fc2 0x51ccc178 65.69.140.83:4739 199.92.111.2:14230 0xd718262a 0xc626b0ea 12.22.207.184:38024 24.19.198.95:12898 0xd2d0a5de 0x5c2b394a 209.142.163.6:2217 38.27.205.30:48228 0x82989176 0xafc7327f 202.188.127.2:1303 153.39.163.191:44251 0x5d1809c5 0x10e828a2 destination address/port source address/port ipv6 only ipv6 with tcp 3ffe:2501:200:1fff::7 (1766) 3ffe:2501:200:3::1 (2794) 0x2cc18cd5 0x40207d3d
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 248 october 2010 3.5.2.11 receive queuing for virtual machine devices (vmdq) virtual machine devices queue (vmdq) is a mechanism to share i/o resources among several consumers. for example, in a virtual system, multiple operating systems are loaded and each executes as though the entire system's resources were at its disposal. however, for the limited number of i/o devices, this presents a problem because each operating system maybe in a separate memory domain and all the data movement and device management has to be done by a virtual machine monitor (vmm). vmm access adds latency and delay to i/o accesses and degrades i/o performance. virtual machine devices (vmds) are designed to reduce the burden of vmm by making certain functions of an i/o device shared and thus can be accessed directly from each guest operating system or virtual machine (vm). the 82598's 64 queues can be accessed by up to 16 vms if configured properly. when the 82598 is enabled for multiple queue direct access for vms, it becomes a vmdq device. note: most configuration and resources are shared across queues. system software must resolve any conflicts in configuration between the vms. when enabled, vmdq assigns a 4-bit vmdq output index to each received packet. the vmdq output index is used to associate the packet to a receive queue as described in section 3.5.2 . vmdq generates its output index in one of the following ways: ? receive packets are associated with receive queues based on the packet destination mac address ? receive packets are associated with receive queues based on the packet vlan tag id packets that do not match any of the enabled filters are assigned with the default vmdq output index value. this might include the following cases: when configured to associate through mac addresses: ? promiscuous mode ? promiscuous mode is used by a virtualized environment to support more than 16 vms, so that the busier vms are assigned specific queues, while all other vms share the default queue. ? broadcast packets ? multicast packets 3.5.2.11.1 association through mac address each of the 16 mac address filters can be associated with a vmdq output index. the vind field in the receive address high (rah) register determines the target queue. packets that do not match any of the mac filters (broadcast, promiscuous, etc.) are assigned with the default index value. software can program different values to the mac filters (any bits in rah or ral) at any time. the 82598 responds to the change on a packet boundary, but does not guarantee the change to take place at some precise time. 3.5.2.12 receive checksum offloading the 82598 supports the offloading of four receive checksum calculations: ? fragment checksum ? ipv4 header checksum ff02::1 (4739) 3ffe:501:8::260:97ff:fe40:efab (14230) 0x0f0c461c 0xdde51bbf fe80::200:f8ff:fe21:67cf (38024) 3ffe:1900:4545:3:200:f8ff:fe21:67cf (44251) 0x4b61e985 0x02d1feef
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 249 ? tcp checksum ? udp checksum for supported packet/frame types, the entire checksum calculation can be off-loaded to the 82598. the 82598 calculates the ipv4 checksum and indicates a pass/fail indication to software via the ipv4 checksum error bit (rdesc.ipe) in the error field of the receive descriptor. similarly, the 82598 calculates the tcp checksum and indicates a pass/fail condition to software via the tcp checksum error bit (rdesc.tcpe). these error bits are valid when the respective status bits indicate the checksum was calculated for the packet (rdesc.ipcs and rdesc.l4cs respectively). similarly, if rfctl.ipv6_dis and rfctl.ip6xsum_dis are cleared to zero the 82598 calculates the tcp or udp checksum for ipv6 packets. it then indicates a pass/fail condition in the tcp/udp checksum error bit (rdesc.tcpe). supported frame types: ? ethernet ii ? ethernet snap table 3-59. supported receive checksum capabilities packet type hardware ip checksum calculation hardware tcp/udp checksum calculation ip header?s protocol field contains a protocol # other than tcp or udp. yes no ipv4 + tcp/udp packets yes yes ipv6 + tcp/udp packets no (n/a) yes ipv4 packet has ip options (ip header is longer than 20 bytes) yes yes ipv6 packet with next header options: hop-by-hop options destinations options routing (with len 0) routing (with len >0) fragment home option no (n/a) no (n/a) no (n/a) no (n/a) no (n/a) no (n/a) yes yes yes no no no packet has tcp or udp options yes yes ipv4 tunnels: ipv4 packet in an ipv4 tunnel ipv6 packet in an ipv4 tunnel no yes (ipv4) no no ipv6 tunnels: ipv4 packet in an ipv6 tunnel ipv6 packet in an ipv6 tunnel no no no no packet is an ipv4 fragment yes udp checksum assist packet type hardware ip checksum calculation hardware tcp/udp checksum calculation packet is greater than 1522 bytes yes yes packet has 802.3ac tag yes yes
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 250 october 2010 the previous table lists general details about what packets are processed. in more detail, the packets are passed through a series of filters to determine if a receive checksum is calculated: mac address filter this filter checks the mac destination address to make sure it is valid (ia match, broadcast, multicast, etc.). the receive configuration settings determine which mac addresses are accepted. see the various receive control configuration registers such as fctrl, mcstctrl (rtcl.upe, mcstctrl.mpe, fctrl.bam), mta, ral, and rah. snap/vlan filter this filter checks the next headers looking for an ip header. it is capable of decoding ethernet ii, ethernet snap, and ieee 802.3ac headers. it skips past any of these intermediate headers and looks for the ip header. the receive configuration settings determine which next headers are accepted. see the various receive control configuration registers such as vlnctrl.vfe, vlnctrl.vet, and vfta. ipv4 filter this filter checks for valid ipv4 headers. the version field is checked for a correct value (four). ipv4 headers are accepted if they are any size greater than or equal to five (dwords). if the ipv4 header is properly decoded, the ip checksum is checked for validity. ipv6 filter this filter checks for valid ipv6 headers, which are a fixed size and have no checksum. the ipv6 extension headers accepted are: hop-by-hop, destination options, and routing. the maximum size next header accepted is 16 dwords (64 bytes). ipv6 extension headers ipv4 and tcp provide header lengths, which allow hardware to easily navigate through these headers on packet reception for calculating checksums and crcs, etc. for receiving ipv6 packets, however, there is no ip header length to help hardware find the packet's ulp (such as tcp or udp) header. one or more ipv6 extension headers might exist in a packet between the basic ipv6 header and the ulp header. the hardware must skip over these extension headers to calculate the tcp or udp checksum for received packets. the ipv6 header length without extensions is 40 bytes. the ipv6 field next header type indicates what type of header follows the ipv6 header at offset 40. it might be an upper layer protocol header such as tcp or udp (next header type of 6 or 17, respectively), or it might indicate that an extension header follows. the final extension header indicates with it's next header type field the type of ulp header for the packet. ipv6 extension headers have a specified order. however, destinations must be able to process these headers in any order. also, ipv6 (or ipv4) can be tunneled using ipv6, and thus another ipv6 (or ipv4) header and potentially its extension headers can be found after the extension headers. the ipv4 next header type is at byte offset 9. in ipv6, the first next header type is at byte offset 6. all ipv6 extension headers have the next header type in their first 8 bits. most have the length in the second 8 bits (offset byte[1]) as follows:
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 251 table 3-60. typical ipv6 extended header format (traditional representation) table 3-61 lists the encodings of the next header type field, and information on determining each header type's length. the ipv6 extension headers are not otherwise processed by the 82598 so their details are not covered here. table 3-61. header type encodings and lengths notes: 1. hop by hop options header is only found in the first next header type of an ipv6 header. 2. when a no next header type is encountered, the rest of the packet should not be processed. 3. encapsulated security payload and authentication ? the 82598 cannot offload packets with this header type. 4. the 82598 hardware acceleration does not support all ipv6 extension header types, see table 3-60 . 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 next header type length header next header type header length ipv6 6 always 40 bytes ipv4 4 offset bits[7:4] unit = 4 bytes tcp 6 offset byte[12]. bits[7:4] unit = 4 bytes udp 17 always 8 bytes hop by hop options 0 note 1 8+offset byte[1] header next header type header length destination options 60 8+offset byte[1] routing 43 8+offset byte[1] fragment 44 always 8 bytes authentication 51 note 3 encapsulating security payload 50 note 3 no next header 59 note 2
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 252 october 2010 5. the rfctl.ipv6_dis bit must be cleared for this filter to pass. udp/tcp filter this filter checks for a valid udp or tcp header. the prototype next header values are 0x11 and 0x06, respectively. 3.5.3 transmit functionality 3.5.3.1 packet transmission output packets are made up of pointer-length pairs constituting a descriptor chain (called descriptor based transmission). software forms transmit packets by assembling the list of pointer-length pairs, storing this information in the transmit descriptor, and then updating the on-chip transmit tail pointer to the descriptor. the transmit descriptor and buffers are stored in host memory. hardware transmits the packet only after it has completely fetched all packet data from host memory and deposited it into the on-chip transmit fifo. this permits tcp or udp checksum computation, and avoids problems with pcie under-runs. another transmit feature of the 82598 is tcp segmentation. the hardware has the capability to perform packet segmentation on large data buffers off-loaded from the network operating system (nos). this feature is discussed in detail in section 3.5.3.4 . transmit tail pointer writes should be to eop descriptors (the software device driver should not write the tail pointer to a descriptor in the middle of a packet/tso). 3.5.3.1.1 transmit data storage data is stored in buffers pointed to by the descriptors. alignment of data is on an arbitrary byte boundary with the maximum size per descriptor limited only to the maximum allowed packet size (16 kb). a packet typically consists of two (or more) buffers, one (or more) for the header and one (or more) for the actual data. each buffer is referred by a different descriptor. some software implementations copy the header(s) and packet data into one buffer and use only one descriptor per transmitted packet. 3.5.3.2 transmit contexts the 82598 provides hardware checksum offload and tcp segmentation facilities. these features enable tcp or udp packet types to be handled more efficiently by performing additional work in hardware, thus reducing the software overhead associated with preparing these packets for transmission. part of the parameters used to control these features are handled though contexts. a context refers to a set of device registers loaded or accessed as a group to provide a particular function. the 82598 supports 256 contexts register sets on-chip. 256 contexts are spread so each eight contexts are related to a separate transmit queue.the transmit queues can contain transmit data descriptors, much like the receive queue, and also transmit context descriptors. a transmit context descriptor differs from a data descriptor as it does not point to packet data. instead, this descriptor provides the ability to write to the on-chip contexts that support the transmit checksum offloading and the segmentation features of the 82598. the 82598 supports one type of transmit context. the extended context is written with a transmit context descriptor dtyp=2 and this context is always used for transmit data descriptor dtyp=3. the idx field contains an index to one of eight on-chip per queue contexts. software must track what context is stored in each idx location.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 253 contexts can be initialized with a transmit context descriptor and then used for a series of related transmit data descriptors. the context, for example, defines the checksum and offload capabilities for a given tcp/ip flow. all the packets of this type can be sent using the same context. each context controls calculation and insertion of up to two checksums. this portion of the context is referred to as the checksum context. in addition to a checksum context, the segmentation context adds information specific to the segmentation capability. this additional information includes the total size of the mac header (tdesc.hdrlenmachdr), the amount of payload data that should be included in each packet (tdesc.mss), l4 header length (tdesc.l4len), ip header length (tdesc.iplen), and information about what type of protocol (tcp, ip, etc.) is used. other than tcp, ip (tdesc.tucmd), most information is specific to the segmentation capability and is therefore ignored for context descriptors that do not have the tse. because there is dedicated resources on-chip for contexts, they remain constant until they are modified by another context descriptor. this means that a context can be used for multiple packets (or multiple segmentation blocks) unless a new context is loaded prior to each new packet. depending on the environment, it might be completely unnecessary to load a new context for each packet. for example, if most traffic generated from a given node is standard tcp frames, this context could be set up once and used for many frames. only when some other frame type is required would a new context need to be loaded by software using a different index or overwriting an existing context. this same logic can also be applied to the segmentation context, though the environment is a more restrictive one. in this scenario, the host is commonly asked to send messages of the same type, tcp/ ip for instance, and these messages also have the same maximum segment size (mss). in this instance, the same segmentation context could be used for multiple tcp messages that require hardware segmentation. 3.5.3.3 transmit descriptors the 82598 supports legacy descriptors and advanced descriptors. legacy descriptors are intended to support legacy drivers, in order to enable fast power up of platform, and to facilitate debug. the legacy descriptors are recognized as such based on the dext bit. in addition, the 82598 supports two types of advanced transmit descriptors: 1. advanced transmit context descriptor, dtyp = 0010b 2. advanced transmit data descriptor, dtyp = 0011b note: dtyp = 0000b and 0001b are reserved values. the transmit data descriptor points to a block of packet data to be transmitted. the tcp/ip transmit context descriptor does not point to packet data. it contains control/context information that is loaded into on-chip registers that affect the processing of packets for transmission. the following sections describe the descriptor formats. 3.5.3.3.1 description 3.5.3.3.1.1 legacy transmit descriptor format to select legacy mode operation, bit 29 (tdesc.dext) should be set to 0b. in this case, the descriptor format is defined as listed in table 3-62 . address and length must be supplied by software. bits in the command byte are optional, as are the cso, and css fields.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 254 october 2010 table 3-62. transmit descriptor (tdesc) layout ? legacy mode table 3-63. transmit descriptor write back format length (16) length (tdesc.length) specifies the length in bytes to be fetched from the buffer address provided. the maximum length associated with any single legacy descriptor is the supported jumbo frame size 16 kb. note: descriptors with zero length (null descriptors) transfer no data. null descriptors can appear only between packets and must have their eop bits set. checksum offset and start ? cso (8) and css (8) a checksum offset (tdesc.cso) field indicates where, relative to the start of the packet, to insert a tcp checksum if this mode is enabled. a checksum start (tdesc.css) field indicates where to begin computing the checksum. both cso and css are in units of bytes 1 . these must both be in the range of data provided to the device in the descriptor. this means for short packets that are padded by software, css and cso must be in the range of the unpadded data length, not the eventual padded length (64 bytes). for an 802.1q header, the offset values depend on the vlan insertion enable bit ( vle ). if they are not set (vlan tagging included in the packet buffers), the offset values should include the vlan tagging. if these bits are set (vlan tagging is taken from the packet descriptor), the offset values should exclude the vlan tagging. hardware does not add the 802.1q ether type or the vlan field following the 802.1q ether type to the checksum. so for vlan packets, software can compute the values to back out only on the encapsulated packet rather than on the added fields. note: udp checksum calculation is not supported by the legacy descriptor as the legacy descriptor does not support the translation of a checksum result of 0x0000 to 0xffff needed to differentiate between a udp packet with a checksum of zero and an udp packet without checksum. as the cso field is eight bits wide, it puts a limit on the location of the checksum to 255 bytes from the beginning of the packet. 63 48 47 40 39 36 35 32 31 24 23 16 15 0 0 buffer address [63:0] 8 vlan css rsvd sta cmd cso length 63 48 47 40 39 36 35 32 31 24 23 16 15 0 0 reserved reserved 8 vlan css rsvd sta cmd cso length 1. even though these are in units of bytes, the checksum calculations of interest typically work on 16- bit words. hardware does not enforce even-byte alignment.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 255 note: cso must be larger than css. software must compute an offsetting entry-to back out the bytes of the header that should not be included in the tcp checksum-and store it in the position where the hardware computed checksum is to be inserted. command byte ? cmd (8) the cmd byte stores the applicable command and has the fields listed in table 3-64 . table 3-64. transmit command (tdesc.cmd) layout ? rsv (bit 7) ? reserved ? vle (bit 6) ? vlan packet enable ? dext (bit 5) ? descriptor extension (0 for legacy mode) ? reserved (bit 4) ? reserved ? rs (bit 3) ? report status ? ic (bit 2) ? insert checksum ? ifcs (bit 1) ? insert fcs ? eop (bit 0) ? end of packet when eop is set, it indicates the last descriptor making up the packet. one or many descriptors can be used to form a packet. hardware inserts a checksum at the offset indicated by the cso field if the insert checksum bit (ic) is set. checksum calculations are for the entire packet starting at the byte indicated by the css field. a value of 0b corresponds to the first byte in the packet. css must be set in the first descriptor for a packet. in addition, ic is ignored if cso or css are out of range. this occurs if ( css >/= length) or ( cso >/= length = one). rs signals the hardware to report the status information. this is used by software that does in-memory checks of the transmit descriptors to determine which ones are done. for example, if software queues up 10 packets to transmit, it can set the rs bit in the last descriptor of the last packet. if software maintains a list of descriptors with the rs bit set, it can look at them to determine if all packets up to (and including) the one with the rs bit set have been buffered in the output fifo. looking at the status byte and checking the descriptor done ( dd ) bit do this. if dd is set, the descriptor has been processed. note: the vle, ifcs, cso, and ic fields should be set in the first descriptor for each packet transmitted. ifcs when set, the hardware appends the mac fcs at the end of the packet. when it is cleared, software should calculate the fcs for proper crc check. there are several cases in which software must set ifcs as follows: ? transmission of short packet while padding is enabled by the hlreg0.txpaden bit ? checksum offload is enabled by the ic bit in the tdesc.cmd ? vlan header insertion enabled by the vle bit in the tdesc.cmd 7 6 5 4 3 2 1 0 rsv vle dext rsv rs ic ifcs eop
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 256 october 2010 ? large send or tcp/ip checksum offload using context descriptor vle indicates that the packet is a vlan packet (hardware should add the vlan ether type and an 802.1q vlan tag to the packet). table 3-65. vlan tag insertion decision table for vlan mode enabled rsvd ? reserved (4) status ? sta (4) table 3-66. transmit status (tdesc.sta) layout dd (bit 0) ? descriptor done status this bit provides transmit status, when rs is set in the command. dd indicates that the descriptor is done and is written back after the descriptor has been processed. when head write-back is enabled, the descriptor write-back is not (with rs set). vlan (16) the vlan field is used to provide the 802.1q/802.1ac tagging information. the vlan field is qualified on the first descriptor of each packet when the vle bit is set to 1b. table 3-67. vlan field (tdesc.vlan) layout vle action 0 send generic ethernet packet. 1 send 802.1q packet; the ethernet type field comes from the vet register and the vlan data comes from the vlan field of the tx descriptor. 321 0 reserved dd 15 13 12 11 0 pri cfi vlan
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 257 3.5.3.3.1.2 advanced transmit context descriptor table 3-68. transmit context descriptor (tdesc) layout ? (type = 0010b) iplen (9) this field holds the value of the ip header length for the ip checksum off-load feature. if an offload is requested, iplen must be greater than or equal to six, and less than or equal to 511. maclen (7) this field indicates the length of the mac header. when an offload is requested (tse or ixsm or txsm is set), machdr must be larger than or equal to 14, and less than or equal to 127. vlan (16) this field contains the 802.1q vlan tag to be inserted in the packet during transmission. this vlan tag is inserted when a packet using this context has its dcmd.vle bit is set. tucmd (11) ? rsv (bit 10-5) ? reserved ? rsv (bit 4) ? reserved ? l4t (bit 3:2) ? l4 packet type (00b: udp; 01b: tcp; 10b, 11b: rsv) ? ipv4(bit 1) ? ip packet type: when 1b, ipv4; when 0b, ipv6 ? snap (bit 0) ? snap indication dtyp (4) this field is always 0010b for this type of descriptor. adv (8) ? reserved (bits 7:6) ? reserved ? dext (bit 5) ? descriptor extension (1b for advanced mode) ? reserved (bits 4:0) ? reserved idx (4) this field holds the index into the hardware context table where this context descriptor is placed. the index is pointing to the per-queue descriptors (eight descriptors). note: because the 82598 supports only eight context descriptors per queue, the msb is reserved and should be set to 0b. 63 48 47 40 39 32 31 16 15 9 8 0 0 rsv vlan maclen iplen 8 mss l4len idx rsv adv dtyp tucmd reserved 63 48 47 40 39 36 35 32 31 24 23 20 19 9 8 0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 258 october 2010 l4len (8) this field holds the layer 4 header length. if tse is set, this field is greater than or equal to 12 and less than or equal to 255. otherwise, this field is ignored. mss (16) this field controls the maximum segment size (mss). this specifies the maximum tcp payload segment sent per frame, not including any header. the total length of each frame (or section) sent by the tcp segmentation mechanism (excluding ethernet crc) is as follows: 1. if tse is set: total length of an outgoing packet is equal to: mss + maclen + iplen + l4len +4 (if vle set) the one exception is the last packet of a tcp segmentation, which is (typically) shorter. software calculates the mss that is the amount of tcp data that should be used before crcs are added. software reduces the mss sent down to hardware by the maximum amount of bytes that can be added for crc. the actual number of bytes of tcp data sent out on the wire is greater than this mss value each time crcs are added by hardware. note: mss is ignored when dcmd.tse is not set. the headers lengths must meet the following: maclen + iplen + l4len < 512 note: maclen is augmented by four bytes if vlan is active. the context descriptor requires valid data only in the fields used by the specific offload options. the following table describes the required valid fields according to the different offload options.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 259 table 3-69. valid fields by offload option 3.5.3.3.1.3 advanced transmit data descriptor table 3-70. advanced transmit data descriptor read format table 3-71. advanced transmit data descriptor write-back format address (64) this field holds the physical address of a data buffer in host memory that contains a portion of a transmit packet. dtalen (16) this field holds the length in bytes of data buffer at the address pointed to by this specific descriptor. rsv(4) reserved dtyp (4) 0011b for this descriptor type required offload valid fields in context tse tsxm ixsm vlan l4len iplen maclen mss l4t ipv4 n/a 1 1 vle yes yes yes yes yes n/a 1 1 vle yes yes yes yes yes 1 1 1 vle yes yes yes yes yes 0 1 x vle no yes no yes yes 0 0 1 vle no yes no no yes 0 0 0 vle no no no no no 0 address[63:0] 8 paylen popts idx sta dcmd dtyp rsv dtalen 63 46 45 40 39 36 35 32 31 24 23 20 19 0 0 rsv 8 rsv sta nxtseq 63 36 35 32 31 0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 260 october 2010 dcmd (8) tse (bit 7) ? tcp segmentation enable this field indicates a tcp segmentation request. when tse is set in the first descriptor of a tcp packet, the hardware uses the corresponding context descriptor in order to perform tcp segmentation. vle (bit 6) ? vlan packet enable this field indicates that the packet is a vlan packet (hardware adds the vlan ether type and an 802.1q vlan tag to the packet). dext (bit 5) ? descriptor extension this field must be 1b to indicate advanced descriptor format (as opposed to legacy) rs (bit 3) ? report status this field signals hardware to report the status information. this is used by software that does in- memory checks of the transmit descriptors to determine which ones are done. for example, if software queues up 10 packets to transmit, it can set the rs bit in the last descriptor of the last packet. if software maintains a list of descriptors with the rs bit set, it can look at them to determine if all packets up to (and including) the one with the rs bit set have been buffered in the output fifo. looking at the status byte and checking the dd bit do this. if dd is set, the descriptor has been processed. note: when the rs bit is not used to force write back of descriptors, the 82598 does not write back descriptor or update the head pointer until half of the internal descriptor cache is available for write back (32 descriptors). the software device driver must make sure that it doesn't wait for such a release of those descriptors before handling new ones to the 82598 as it might result is a deadlock situation. to guarantee that this case doesn't occur, a packet should not span more than (host ring size ? 31) descriptors. ifcs (bit 1) ? insert fcs when this field is set, the hardware appends the mac fcs at the end of the packet. when cleared, software should calculate the fcs for proper crc check. there are several cases in which software must set ifcs as follows: ? transmission of short packet while padding is enabled by the hlreg0.txpaden bit ? checksum offload is enabled by the either ic txsm or ixsm bits in the tdesc.dcmd ? vlan header insertion enabled by the vle bit in the tdesc.dcmd ? tcp segmentation offload enabled by the tse bit in the tdesc.dcmd eop (bit 0) ? end of packet packets can span multiple transmit buffers. eop indicates whether this is the last buffer for an incoming packet. note: it is recommended that hlreg0.txpaden be enabled when tse is true since the last frame can be shorter than 60 bytes ? resulting in a bad frame if txpaden is disabled. descriptors with zero length, transfer no data. even if they have the rs bit in the command byte set, the dd field in the status word is not written when hardware processes them. sta (4) rsv (bit 3:2) ? reserved dd (bit 0) ? descriptor done
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 261 idx (4) this field holds the index into the hardware context table to indicate which of the eight per-queue contexts should be used for this request. popts (6) rsv (bit 5) ? reserved txsm (bit 1) ? insert tcp/udp checksum when 1b, tcp/udp checksum is inserted. in this case tucmd.lp4 indicates whether the checksum is tcp or udp. when dcmd.tse is set txsm must be set to 1b. ixsm (bit 0) ? insert ip checksum this field indicates that ip checksum is inserted. in ipv6 mode, it must be reset to 0b. if dcmd.tse is set, and tucmd.ipv4 is set, ixsm must be set to 1b. paylen (18) this field indicates the total length in bytes of the large send packet. paylen is ignored if tse is not set. note: when a packet spreads over multiple descriptors, all the descriptor fields are only valid in the 1st descriptor of the packet, except for rs , which is always checked, and eop , which is always set at last descriptor of the series. 3.5.3.3.2 transmit descriptor structure the transmit descriptor ring structure is shown in figure 3-26 each ring uses a contiguous memory space. a pair of hardware registers maintains the transmit descriptor ring in the host memory. new descriptors are added to the ring by software by writing descriptors into the circular buffer memory region and moving the tail pointer associated with that ring. the tail pointer points one entry beyond the last hardware owned descriptor. transmission continues up to the descriptor where head equals tail at which point the queue is empty. hardware maintains internal circular queues of 64 descriptors per queue to hold the descriptors that were fetched from the software ring. the hardware writes back used descriptors just prior to advancing the head pointer(s). descriptors passed to hardware should not be manipulated by software until the head pointer has advanced past them.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 262 october 2010 figure 3-26. transmit descriptor ring structure shaded boxes in figure 3-26 show descriptors that have been transmitted but not yet reclaimed by software. reclaiming involves freeing up buffers associated with the descriptors. the transmit descriptor ring is described by the following registers: ? transmit descriptor base address (tdba) register (31:0) ? this register indicates the start address of the descriptor ring buffer in the host memory; this 64-bit address is aligned on a 16- byte boundary and is stored in two consecutive 32-bit registers. hardware ignores the lower four bits. ? transmit descriptor length (tdlen) register (31:0) ? this register determines the number of bytes allocated to the circular buffer. this value must be 0b modulo 128. ? transmit descriptor head (tdh) register (31:0) ? this register holds a value that is an offset from the base and indicates the in-progress descriptor. there can be up to 32k-8 descriptors in the circular buffer. reading this register returns the value of head corresponding to descriptors already loaded in the output fifo.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 263 ? transmit descriptor tail (tdt) register (31:0) ? this register holds a value that is an offset from the base and indicates the location beyond the last descriptor hardware can process. this is the location where software writes the first new descriptor. the base register indicates the start of the circular descriptor queue and the length register indicates the maximum size of the descriptor ring. the lower seven bits of length are hard-wired to 0b. byte addresses within the descriptor buffer are computed as follows: address = base + (ptr * 16), where ptr is the value in the hardware head or tail register. the size chosen for the head and tail registers permit a maximum of 64 kb-8 descriptors or approximately 16 kb packets for the transmit queue given an average of four descriptors per packet. once activated, hardware fetches the descriptor indicated by the hardware head register. the hardware tail register points one beyond the last valid descriptor. software reads the head register to determine which packets those logically before the head have been transferred to the on-chip fifo or transmitted. all the registers controlling the descriptor rings behaviors should be set before transmit is enabled, apart from the tail registers which are used during the regular flow of data. note: software can determine if a packet has been sent by setting the rs bit in the transmit descriptor command field and checking the transmit descriptor dd bit in memory. in general, hardware prefetches packet data prior to transmission. hardware typically updates the value of the head pointer after storing data in the transmit fifo. the process of checking for completed packets consists of one of the following: ? scan memory. ? read the hardware head register. all packets up to but excluding the one pointed to by head have been sent or buffered and can be reclaimed. ? issue an interrupt. an interrupt condition is generated each time a packet was transmitted or received and a descriptor was write-back or transmit queue goes empty (eicr.rtxq[0-19]). this interrupt can either be enabled or masked. 3.5.3.3.3 transmit descriptor fetching the descriptor processing strategy for transmit descriptors is essentially the same as for receive descriptors except that a different set of thresholds are used. when the on-chip buffer is empty, a fetch happens as soon as any descriptors are made available (host writes to the tail pointer). when the on-chip buffer is nearly empty (txdctl[n].pthresh), a prefetch is performed each time enough valid descriptors (txdctl[n].hthresh) are available in host memory and no other dma activity of greater priority is pending (descriptor fetches and write-backs or packet data transfers). when the number of descriptors in host memory is greater than the available on-chip descriptor storage, the 82598 might elect to perform a fetch that is not a multiple of cache line size. the hardware performs this non-aligned fetch if doing so results in the next descriptor fetch being aligned on a cache line boundary. this enables the descriptor fetch mechanism to be more efficient in the cases where it has fallen behind software. note: software tail updates should be done at packet boundaries. for example, the last valid descriptor should have its eop bit set. the last valid descriptor should not be a context descriptor. the 82598 never fetches descriptors beyond the descriptor tail pointer.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 264 october 2010 3.5.3.3.4 transmit descriptor write-back the descriptor write-back policy for transmit descriptors is similar to that for receive descriptors with a few additional factors. descriptors are written back in one of three cases: ? txdctl[n].wthresh = zero and a descriptor which has rs set is ready to be written back ? the corresponding itr counter has reached zero ? txdctl[n].wthresh > zero and txdctl[n].wthresh descriptors have accumulated for the first condition, write-backs are immediate. this is the default operation. the other two conditions are only valid if descriptor bursting is enabled. in the second condition, the itr counter is used to force a timely write-back of descriptors. the first packet after timer initialization starts the timer. timer expiration flushes any accumulated descriptors and sets an interrupt event (txdw). for the final condition, if txdctl[n].wthresh descriptors are ready for write-back, the write-back is performed. another possibility for descriptor write back is to use the transmit completion head write-back as explained in section 3.5.3.7 . 3.5.3.4 tcp segmentation hardware tcp segmentation is one of the off-loading options of the tcp/ip stack. this is often referred to as tso. this feature enables the tcp/ip stack to pass to the network device driver a message to be transmitted that is bigger than the maximum transmission unit (mtu) of medium. it is then the responsibility of the software device driver and hardware to divide the tcp message into mtu size frames that have appropriate layer 2 (ethernet), 3 (ip), and 4 (tcp) headers. these headers must include sequence number, checksum fields, options and flag values as required. note that some of these values (such as the checksum values) is unique for each packet of the tcp message, and other fields such as the source ip address is constant for all packets associated with the tcp message. crc appending (hlreg0.txcrcen) must be enabled in tcp segmentation mode because crc is inserted by hardware. padding (hlreg0.txpaden) must be enabled in tcp segmentation mode, since the last frame might be shorter than 60 bytes ? resulting in a bad frame if txpaden is disabled. the offloading of these mechanisms to the software device driver and the 82598 saves significant cpu cycles. the software device driver shares the additional tasks to support these options with the 82598. although the 82598's tcp segmentation offload implementation was specifically designed to take advantage of microsoft's* tcp segmentation offload (tso) feature, the hardware implementation was made generic enough so that it could also be used to segment traffic from other protocols. for example, this feature could be used any time it is desirable for hardware to segment a large block of data for transmission into multiple packets that contain the same generic header. 3.5.3.4.1 assumptions the following assumptions apply to the tcp segmentation implementation in the 82598: ? the rs bit operation is not changed. interrupts are set after data in the buffers pointed to by individual descriptors are transferred to hardware. 3.5.3.4.2 transmission process the transmission process for regular (non-tcp segmentation packets) involves:
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 265 ? the protocol stack receives from an application a block of data that is to be transmitted. ? the protocol stack calculates the number of packets required to transmit this block based on the mtu size of the media and required packet headers. for each packet of the data block: ? ethernet, ip and tcp/udp headers are prepared by the stack. ? the stack interfaces with the device driver and commands the driver to send the individual packet. ? the software device driver gets the frame and interfaces with the hardware. ? the hardware reads the packet from host memory (via dma transfers). ? the software device driver returns ownership of the packet to the nos when the hardware has completed the dma transfer of the frame (indicated by an interrupt). the transmission process for the 82598 tcp segmentation offload implementation involves: ? the protocol stack receives from an application a block of data that is to be transmitted. ? the stack interfaces to the software device driver and passes the block down with the appropriate header information. ? the software device driver sets up the interface to the hardware (via descriptors) for the tcp segmentation context. the hardware transfers the packet data and performs the ethernet packet segmentation and transmission based on offset and payload length parameters in the tcp/ip context descriptor including: ? packet encapsulation ? header generation and field updates including ipv4/ipv6 and tcp/udp checksum generation ? the software device driver returns ownership of the block of data to the nos when the hardware has completed the dma transfer of the entire data block (indicated by an interrupt). 3.5.3.4.2.1 tcp segmentation performance performance improvements for a hardware implementation of tcp segmentation offload include: ? the stack does not need to partition the block to fit the mtu size, saving cpu cycles. ? the stack only computes one ethernet, ip, and tcp header per segment, saving cpu cycles. ? the stack interfaces with the software device driver only once per block transfer, instead of once per frame. ? larger pci bursts are used which improves bus efficiency (lowering transaction overhead). ? interrupts are easily reduced to one per tcp message instead of one per packet. ? fewer i/o accesses are required to command the hardware. 3.5.3.4.3 packet format a tcp message can be as large as 256 kb and is generally fragmented across multiple pages in host memory. the 82598 partitions the data packet into standard ethernet frames prior to transmission. the 82598 supports calculating the ethernet, ip, tcp, and udp headers (including checksum) on a frame- by-frame basis.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 266 october 2010 table 3-72. tcp/ip packet format frame formats supported by the 82598 include: ? ethernet 802.3 ? ieee 802.1q vlan (ethernet 802.3ac) ? ethernet type 2 ? ethernet snap ? ipv4 headers with options ? ipv6 headers with extensions ? tcp with options ? udp with options vlan tag insertion is handled by hardware. note: ip tunneled packets are not supported for offloading under large send operation. the 82598 does not support full offload of ecn bits in the tcp header via tcp segmentation to resolve when ever an ecn response is needed software can send the first segment with the cwr bit set and the rest of the segments offloaded as tso with the cwr bit clear. 3.5.3.4.4 tcp segmentation indication software indicates a tcp segmentation transmission context to the hardware by setting up a tcp/ip context transmit descriptor (see section 3.5.3.3 ). the purpose of this descriptor is to provide information to the hardware to be used during the tcp segmentation offload process. setting the tse bit in the dcmd field to 1b indicates that this descriptor refers to the tcp segmentation context (as opposed to the normal checksum offloading context). this causes the checksum offloading, packet length, header length, and maximum segment size parameters to be loaded from the descriptor into the 82598. the tcp segmentation prototype header is taken from the packet data itself. software must identity the type of packet that is being sent (ipv4/ipv6, tcp/udp, other), calculate appropriate checksum offloading values for the desired checksums, and calculate the length of the header which is prepended. the header can be up to 240 bytes in length. once the tcp segmentation context has been set, the next descriptor provides the initial data to transfer. this first descriptor(s) must point to a packet of the type indicated. furthermore, the data it points to might need to be modified by software as it serves as the prototype header for all packets within the tcp segmentation context. the following sections describe the supported packet types and the various updates which are performed by hardware. this should be used as a guide to determine what must be modified in the original packet header to make it a suitable prototype header. the following summarizes the fields considered by the software device driver for modification in constructing the prototype header. ip header ? length should be set to zero ethernet ipv4/ipv6 tcp/udp data fcs
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 267 for ipv4 headers ? identification field should be set as appropriate for first packet of send (if not already) ? header checksum should be zeroed out unless some adjustment is needed by the driver tcp header ? sequence number should be set as appropriate for first packet of send (if not already) ? psh, and fin flags should be set as appropriate for last packet of send ? tcp checksum should be set to the partial pseudo-header checksum as follows (there is a more detailed discussion of this in section 3.5.3.4.5 : table 3-73. tcp partial pseudo-header checksum for ipv4 table 3-74. tcp partial pseudo-header checksum for ipv6 udp header ? checksum should be set as in tcp header previously described. the 82598's dma function fetches the ethernet, ip, and tcp/udp prototype header information from the initial descriptor(s) and saves them (on-chip) for individual packet header generation. the following sections describe the updating process performed by the hardware for each frame sent using the tcp segmentation capability. 3.5.3.4.5 ip and tcp/udp headers this section outlines the format and content for the ip, tcp, and udp headers. the 82598 requires baseline information from the device driver in order to construct the appropriate header information during the segmentation process. note that header fields that are modified by the 82598 are highlighted in the figures that follow. note: ipv4 requires the use of a checksum for the header and does not use a header checksum. ipv4 length includes the tcp and ip headers, and data. ipv6 length does not include the ipv6 header. ip source address ip destination address zero layer 4 protocol id zero ipv6 source address ipv6 final destination address zero zero next header
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 268 october 2010 note: the ip header is first shown in the traditional (rfc 791) representation, and because byte and bit ordering is confusing in that representation, the ip header is also shown in little endian format. the actual data is fetched from memory in little endian format. figure 3-27. ipv4 header (traditional representation) figure 3-28. ipv4 header (little endian order) identification is incremented on each packet. flags field definition: the flags field is defined as follows. note that hardware does not evaluate or change these bits. ? mf ? more fragments ? nf ? no fragments ? reserved the 82598 does tcp segmentation, not ip fragmentation. ip fragmentation might occur in transit through a network's infrastructure.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 269 figure 3-29. ipv6 header (traditional representation) figure 3-30. ipv6 header (little endian order) a tcp or udp frame uses a 16-bit wide one's complement checksum. the checksum word is computed on the outgoing tcp or udp header and payload, and on the pseudo header. details on checksum computations are provided in section 3.5.3.4.6 . note: tcp requires the use of checksum; optional for udp. the tcp header is first shown in the traditional (rfc 793) representation, and because byte and bit ordering is confusing in that representation, the tcp header is also shown in little endian format. the actual data is fetched from memory in little endian format. figure 3-31. tcp header (traditional representation)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 270 october 2010 figure 3-32. tcp header (little endian) the tcp header is always a multiple of 32-bit words. tcp options can occupy space at the end of the tcp header and are a multiple of eight bits in length. all options are included in the checksum. the checksum also covers a 96-bit pseudo header conceptually prefixed to the tcp header (see figure 3-33 ). for ipv4 packets, this pseudo header contains the ip source address, the ip destination address, the ip protocol field, and tcp length. software pre-calculates the partial pseudo header sum, which includes ipv4 sa, da and protocol types, but not the tcp length, and stores this value into the tcp checksum field of the packet. for both ipv4 and ipv6, hardware needs to factor in the tcp length to the software supplied pseudo header partial checksum. note: when calculating the tcp pseudo header, one common question is whether the protocol id field is added to the lower or upper byte of the 16-bit sum. the protocol id field should be added to the least significant byte (lsb) of the 16-bit pseudo header sum, where the most significant byte (msb) of the 16-bit sum is the byte that corresponds to the first checksum byte out on the wire. the tcp length field is the tcp header length including option fields plus the data length in bytes, which is calculated by hardware on a frame-by-frame basis. the tcp length does not count the 12 bytes of the pseudo header. the tcp length of the packet is determined by hardware as: ? tcp length = min(mss,payloadlen) + l5_len the two flags that can be modified are defined as: ? psh ? receiver should pass this data to the application without delay ? fin ? sender is finished sending data the handling of these flags is described in section 3.5.3.4.7 , ip/tcp/udp header updating. payload is normally mss except for the last packet where it represents the remainder of the payload. figure 3-33. tcp/udp pseudo header content for ipv4 (traditional representation) the layer 4 protocol id value in the pseudo-header identifies the upper-layer protocol (such as, 6 for tcp or 17 for udp). ipv4 source address ipv4 destination address zero layer4 protocol id tcp/udp length
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 271 figure 3-34. tcp/udp pseudo header content for ipv6 (traditional representation) note: from the rfc2460 specification: ? if the ipv6 packet contains a routing header, the destination address used in the pseudo-header is that of the final destination. at the originating node, that address is in the last element of the routing header; at the recipient(s), that address is in the destination address field of the ipv6 header. ? the next header value in the pseudo-header identifies the upper-layer protocol (such as, 6 for tcp or 17 for udp). it differs from the next header value in the ipv6 header if there are extension headers between the ipv6 header and the upper-layer header. ? the upper-layer packet length in the pseudo-header is the length of the upper-layer header and data (tcp header plus tcp data). some upper-layer protocols carry their own length information (such as length field in the udp header); for such protocols, that is the length used in the pseudo- header. other protocols (such as tcp) do not carry their own length information, in which case the length used in the pseudo-header is the payload length from the ipv6 header, minus the length of any extension headers present between the ipv6 header and the upper-layer header. ? unlike ipv4, when udp packets are originated by an ipv6 node, the udp checksum is not optional. that is, whenever originating a udp packet, an ipv6 node must compute a udp checksum over the packet and the pseudo-header, and, if that computation yields a result of zero, it must be changed to hex ffff for placement in the udp header. ipv6 receivers must discard udp packets containing a zero checksum, and should log the error. a type 0 routing header has the following format: table 3-75. ipv6 routing header (traditional representation) ? next header ? 8-bit selector. identifies the type of header immediately following the routing header. uses the same values as the ipv4 protocol field [rfc-1700 et seq.]. ipv6 source address ipv6 final destination address tcp/udp packet length zero next header next header hdr ext len routing type 0 segments left n reserved address[1] address[2] ? final destination address[n]
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 272 october 2010 ? hdr ext len ? 8-bit unsigned integer. length of the routing header in 8-octet units, not including the first eight octets. for the type 0 routing header, hdr ext len is equal to two times the number of addresses in the header. ? routing type ? 0. ? segments left ? 8-bit unsigned integer. number of route segments remaining, for example, number of explicitly listed intermediate nodes still to be visited before reaching the final destination. equal to n at the source node. ? reserved ? 32-bit reserved field. initialized to zero for transmission; ignored on reception. ? address[1..n] ? vector of 128-bit addresses, numbered 1 to n. the udp header is always 8 bytes in size with no options. figure 3-35. udp header (traditional representation) figure 3-36. udp header (little endian order) udp pseudo header has the same format as the tcp pseudo header. the pseudo header conceptually prefixed to the udp header contains the ipv4 source address, the ipv4 destination address, the ipv4 protocol field, and the udp length (same as the tcp length previously discussed). this checksum procedure is the same as is used in tcp. unlike the tcp checksum, the udp checksum is optional (for ipv4). software must set the txsm bit in the tcp/ip context transmit descriptor to indicate that a udp checksum should be inserted. hardware does not overwrite the udp checksum unless the txsm bit is set. 3.5.3.4.6 transmit checksum offloading with tcp segmentation the 82598 supports checksum off-loading as a component of the tcp segmentation offload feature and as a standalone capability. section 3.5.3.4.8 describes the interface for controlling the checksum off- loading feature. this section describes the feature as it relates to tcp segmentation. the 82598 supports ip and tcp/udp header options in the checksum computation for packets that are derived from the tcp segmentation feature. note: the 82598 is capable of computing one level of ip header checksum and one tcp/udp header and payload checksum. in case of multiple ip headers, the software device driver has to compute all but one ip header checksum. the 82598 calculates checksums on the fly on a frame-by-frame basis and inserts the result in the ip/tcp/udp headers of each frame. the tcp and udp checksums are a result of performing the checksum on all bytes of the payload and the pseudo header.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 273 three specific types of checksum are supported by the hardware in the context of the tcp segmentation offload feature: ? ipv4 checksum ? tcp checksum ? udp checksum each packet that is sent via the tcp segmentation offload feature optionally includes the ipv4 checksum and the tcp or udp checksum. all checksum calculations use a 16-bit wide one's complement checksum. the checksum word is calculated on the outgoing data. the checksum field is written with the 16-bit one's complement of the one's complement sum of all 16-bit words in the range of css to cse, including the checksum field itself. table 3-76. supported transmit checksum capabilities the following table lists the conditions of when checksum offloading can/should be calculated. packet type hardware ip checksum calculation hardware tcp/udp checksum calculation ipv4 packets yes yes ipv6 packets (no ip checksum in ipv6) na yes packet is greater than 1552 bytes yes yes packet has 802.3ac tag yes yes packet has ip option (ip header is longer than 20 bytes) yes yes packet has tcp or udp options yes yes ip header?s protocol field contains protocol # other than tcp or udp. yes no packet type ipv4 tcp/udp reason non-tso yes no ip raw packet (non-tcp/udp protocol) yes yes tcp segment or udp datagram with checksum offload no no non-ip packet or checksum not offloaded tso yes yes for tso, checksum offload must be done
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 274 october 2010 3.5.3.4.7 ip/tcp/udp header updating ip/tcp/udp header is updated for each outgoing frame based on the ip/tcp header prototype which hardware dma's from the first descriptor(s) and stores on chip. the ip/tcp/udp headers are fetched from host memory into an on-chip 240 byte header buffer once for each tcp segmentation context (for performance reasons, this header is not fetched again for each additional packet that is derived from the tcp segmentation process). the checksum fields and other header information are later updated on a frame-by-frame basis. the updating process is performed concurrently with the packet data fetch. the following sections define what fields are modified by hardware during the tcp segmentation process by the 82598. note: software must make paylen and hdrlen value of context descriptors correct. otherwise, the failure of tsos due to either under-run or over-run can cause hardware to send bad packets or even cause tx hardware to hang. the indication of a tso failure can be checked in the tstfc statistic register. 3.5.3.4.7.1 tcp/ip/udp header for the first frames hardware makes the following changes to the headers of the first packet that is derived from each tcp segmentation context. mac header (for snap) ? type/len field = mss + maclen + iplen + l4len ? 14 ipv4 header ? ip total length = mss + l4len + iplen ? ip checksum ipv6 header ? payload length = mss + l4len + iplen ? 0x28 (ip base header length) tcp header ? sequence number: the value is the sequence number of the first tcp byte in this frame. ? if fin flag = 1b, it is cleared in the first frame. ? if psh flag =1b, it is cleared in the first frame. ? tcp checksum udp header ? udp length: mss + l4len ? udp checksum 3.5.3.4.7.2 tcp/ip/udp header for the subsequent frames hardware makes the following changes to the headers for subsequent packets that are derived as part of a tcp segmentation context: number of bytes left for transmission = paylen ? (n * mss). n is the number of frames that have been transmitted. mac header (for snap packets) ? type/len field = mss + maclen + iplen + l4len ? 14
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 275 ipv4 header ? ip identification: incremented from last value (wrap around) ? ip total length = mss + l4len + iplen ? ip checksum ipv6 header ? payload length = mss + l4len + iplen ? 0x28 (ip base header length) tcp header ? sequence number update: add previous tcp payload size to the previous sequence number value. this is equivalent to adding the mss to the previous sequence number. ? if fin flag = 1b, it is cleared in these frames. ? if psh flag =1b, it is cleared in these frames. ? tcp checksum udp header ? udp length: mss + l4len ? udp checksum 3.5.3.4.7.3 tcp/ip/udp header for the last frame the hardware makes the following changes to the headers for the last frame of a tcp segmentation context: last frame payload bytes = paylen ? (n * mss) mac header (for snap packets) ? type/len field = last frame payload bytes + maclen + iplen + l4len ? 14 ipv4 header ? ip total length = last frame payload bytes + l4len + iplen ? ip identification: incremented from last value (wrap around configurable based on 15-bit width or 16-bit width) ? ip checksum ipv6 header ? payload length = last frame payload bytes + l4len + iplen ? 0x28 (ip base header length) tcp header ? sequence number update: add previous tcp payload size to the previous sequence number value. this is equivalent to adding the mss to the previous sequence number. ? if fin flag = 1b, set it in this last frame ? if psh flag =1b, set it in this last frame ? tcp checksum udp header ? udp length: last frame payload bytes + l4len
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 276 october 2010 ? udp checksum 3.5.3.4.8 ip/tcp/udp checksum offloading the 82598 performs checksum offloading as an optional part of the tcp/udp segmentation offload feature. these specific checksums are supported under tcp segmentation: ? ipv4 checksum ? tcp checksum ? udp checksum checksum offloading may also be performed in a single-send packet. figure 3-37. data flow
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 277 3.5.3.5 ip/tcp/udp transmit checksum offloading in non- segmentation mode the previous section on tcp segmentation offload describes the ip/tcp/udp checksum offloading mechanism used in conjunction with tcp segmentation. the same underlying mechanism can also be applied as a standalone feature. the main difference in normal packet mode (non-tcp segmentation) is that only the checksum fields in the ip/tcp/udp headers need to be updated. before taking advantage of the 82598's enhanced checksum offload capability, a checksum context must be initialized. for the normal transmit checksum offload feature this is performed by providing the device with a tcp/ip context descriptor. for additional details on contexts, refer to section 3.5.3.3.2 . note: enabling the checksum offloading capability without first initializing the appropriate checksum context leads to unpredictable results. note: crc appending (hlreg0.txcrcen) must be enabled in tcp/ip checksum mode, since crc must be inserted by hardware after the checksums have been calculated. as mentioned in section 3.5.3.3 , it is not necessary to set a new context for each new packet. in many cases, the same checksum context can be used for a majority of the packet stream. each checksum operates independently. inserting the ip and tcp checksums for each packet are enabled through the transmit data descriptor popts.tsxm and popts.ixsm fields, respectively. 3.5.3.5.1 ip checksum three fields in the transmit context descriptor set the context of the ip checksum offloading feature: ? tucmd.ipv4 ? iplen ? maclen tucmd.ipv4=1b specifies that the packet type for this context is ipv4 and that the ip header checksum should be inserted. tucmd.ip=0b indicates that the packet type is ipv6 (or some other protocol) and that the ip header checksum should not be inserted. maclen specifies the byte offset from the start of the transferred data to the first byte to be included in the checksum, the start of the ip header. the minimal allowed value for this field is 14. note that the maximum value for this field is 127. this is adequate for typical applications. note: the maclen+iplen value needs to be less than the total dma length for a packet. if this is not the case, the results are unpredictable. iplen specifies the ip header length the maximum allowed value is 511 bytes (the ip checksum should stop after maclen+iplen. this is limited to the first 127+511 bytes of the packet and must be less than or equal to the total length of a given packet. if this is not the case, the result is unpredictable. the 16-bit ipv4 header checksum is placed at the two bytes starting at maclen+10. 3.5.3.5.2 tcp checksum three fields in the transmit context descriptor set the context of the tcp checksum offloading feature: ? maclen ? iplen ? tucmd.l4t
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 278 october 2010 tucmd.l4t=1b specifies that the packet type is tcp, and that the 16-bit tcp header checksum should be inserted at byte offset maclen+iplen+16. tucmd.l4t=0 indicates that the packet is udp and that the 16-bit checksum should be inserted starting at byte offset maclen+iplen+6. maclen+iplen specifies the byte offset from the start of the transferred data to the first byte to be included in the checksum, the start of the tcp header. the minimal allowed value for this sum is 18/28 for udp or tcp, respectively. note that the maximum value for these fields is 127 for maclen and 511 for iplen. this is adequate for typical applications. note: the maclen+iplen value needs to be less than the total dma length for a packet. if this is not the case, the results are unpredictable. the tcp/udp checksum always continues to the last byte of the dma data. note: for non-tso, software still needs to calculate a full checksum for the tcp/udp pseudo- header. this checksum of the pseudo-header should be placed in the packet data buffer at the appropriate offset for the checksum calculation. 3.5.3.6 multiple transmit queues the number of transmit queues is increased to 32 to support multiple cpus and virtual systems. 3.5.3.6.1 description in transmission, each processor sets a queue in the host memory. figure 3-38. multiple queues in transmit
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 279 3.5.3.7 transmit completions head write back in legacy hardware, transmit requests are completed by writing the dd bit to the transmit descriptor ring. this causes cache thrash since both the software device driver and hardware are writing to the descriptor ring in host memory. instead of writing the dd bits to signal that a transmit request is complete, hardware can write the contents of the descriptor queue head to host memory. the software device driver reads that memory location to determine which transmit requests are complete. to improve the performance of this feature, the software device driver needs to program the dca registers to configure which cpu is processing each tx queue. 3.5.3.7.1 description the head counter is reflected in a memory location that is allocated by the software for each queue. head write-back occurs if tdwbal#.head_wb_en is set for this queue and the rs bit is set in the tx descriptor, following a corresponding data upload into packet buffer. the software device driver has control on this feature through tx queue 63:0 write-back address, low and high (thus allowing 64-bit address). the low register's lsb hold the control bits. ? the head_wb_en bit enables activation of head write-back. in this case, no descriptor write-back is executed. ? the upper 30 bits of this register hold the lowest 32 bits of the head write-back address, assuming that the two last bits are zero. the high register holds the high part of the 64-bit address. the 82598 writes the 32 bits of the queue head register to the address pointed by the tdewbah/ tdwbal registers. 3.5.4 interrupts 3.5.4.1 registers the interrupt logic consists of the registers listed in the following table, plus the registers associated with msi/msi-x signaling. register acronym function extended interrupt cause eicr extended icr. records all interrupt causes ? an interrupt is signaled when unmasked bits in this register are set. extended interrupt cause set eics enables software to set bits in the extended interrupt cause register. extended interrupt mask set/read eims sets or read bits in the extended interrupt mask. extended interrupt mask clear eimc clears bits in the extended interrupt mask.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 280 october 2010 extended interrupt cause registers (eicr) this register records the interrupt causes to provide to the software information on the interrupt source. the interrupt causes include: 1. the rx and tx queues, each queue can be mapped to one of the 16 interrupt cause bits (rtxq) available in this register, in non msi-x mode this mapping is defined by the 82598 software device driver and it uses the same mapping mechanism used in the msi-x allocation registers (ivar). see section 3.5.4.6 for more details on the mapping mechanism. 2. indication for the tcp timer interrupt. 3. other bits in this register are the legacy indication of interrupts as the sdp bits, management, unrecoverable ecc errors and link status change. there is a specific other cause bit that is set if one of these bits are set, this bit can be mapped to a specific msi-x interrupt message. in msi-x mode the bits in this register can be configured to auto-clear when the msi-x interrupt message is sent, in order to minimize driver overhead, and when using msi-x interrupt signaling. in addition, software can configure the register not to be read-on clear beside other cause bits if the gpie.ocd bit is set. when set, only the other causes bits are clear on read ? the only case where software reads the eicr in this mode, is if the other interrupt bit is set. in systems that do not support msi-x, reading the eicr register clears it's bits or writing 1b's clears the corresponding bits in this register. most systems have write buffers that minimizes overhead, but this might require a read operation to guarantee that the write has been flushed from posted buffers. extended interrupt cause set register (eics) this registers enables triggering an immediate interrupt by software, by writing 1b to bits in eics the corresponding bits in eics is set and the relevant eitr is reset (as if the counter was written to zero) if gpie.eimen bit is set. if gpie.eimen bit is not set, than setting the bit does not cause an immediate interrupt, but it waits for the eitr to expire. used usually to rearm interrupts, software didn't have time to handle in the current interrupt routine. extended interrupt mask set and read register (eims) extended interrupt mask clear register (eimc) interrupts appear on pcie only if the interrupt cause bit is a 1b and the corresponding interrupt mask bit is 1b. software blocks asserting an interrupt by clearing the corresponding bit in the mask register. the cause bit stores the interrupt event regardless of the state of the mask bit. clear and set make this register more thread safe by avoiding a read-modify-write operation on the mask register. the mask bit is set for each bit written to a one in the set register and cleared for each bit written in the clear register. reading the set register (eims) returns the current mask register value. extended interrupt auto clear enable register (eiac) each bit in this register enables clearing of the corresponding bit in eicr following interrupt generation. when a bit is set, the corresponding bit in eicr is automatically cleared following an interrupt. extended interrupt auto clear eiac enables bits in the eicr to be cleared automatically following msi-x interrupt without a read or write of the eicr. extended interrupt auto mask eiam enables bits in the eims to be set and cleared automatically.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 281 when used in conjunction with msi-x interrupt vector, this feature enables interrupt cause recognition and selective interrupt cause and mask bits reset without requiring software to read the eicr register. as a result, the penalty related to a pcie read transaction is avoided. extended interrupt auto mask enable register (eiam) each bit in this register enables the setting of the corresponding bit in the eimc register following a write-to-clear to the eicr register or setting the corresponding bit in the eims register following a write-to-set to eics. this register is provided in case msi-x is not used, and therefore auto-clear through eiac register is not available. in addition, when in msi-x mode and gpie.eiame is set, software can set the bits of this register to select mask bits that is reset during interrupt processing. in this mode, each bit in this register enables setting of the corresponding bit in eimc following interrupt generation. 3.5.4.2 interrupt moderation an interrupt is generated upon receiving of incoming packets, as throttled by the eitr registers. there are 16 eitr registers, each one is allocated to a vector of msi-x. when an msi-x interrupt is activated, each active bit in eicr can trigger an interrupt vector. allocating msi-x vectors is set by the setting of ivar[23:0] registers. following the allocation, the eitr corresponding to the msi-x vector is tied to the same allocation (eitr0 is allocated to msi-x[0] and its corresponding interrupts, eitr1 is allocated to msi-x[1] and its corresponding interrupts etc.). when msi-x is not activated, the interrupt moderation is controlled by eitr[0]. software can use eitr to limit the rate of delivery of interrupts to the host cpu. this register provides a guaranteed inter-interrupt delay between interrupts asserted by the 82598, regardless of network traffic conditions. the following algorithm to convert the inter-interrupt interval value to the common interrupts/sec performance metric: interrupts/sec = (256 * 10 -9 sec * interval) -1 for example, if the interval is programmed to 500d, the 82598 guarantees the cpu is not interrupted by the 82598 for at least 128 ? s from the last interrupt. the maximum observable interrupt rate from the 82598 should not exceed 7813 interrupts/sec. inversely, inter-interrupt interval value can be calculated as: inter-interrupt interval = (256 * 10 -9 sec * interrupts/sec) -1 the optimal performance setting for this register is very system and configuration specific. the extended interrupt throttle register should default to 0b upon initialization and reset. it loads in the value programmed by the software after software initializes the device. the 82598 implements interrupt moderation to reduce the number of interrupts software processes. the moderation scheme is based on the eitr. each time an interrupt event happens, the corresponding bit in the eicr is activated. however, an interrupt message is not sent out on the pcie interface until the eitr counter assigned to the proper msi-x vector that supports the eicr bit has counted down to zero. the eitr counter is reloaded after it has reached zero with its initial value and the process repeats again. the interrupt flow should follow the following diagram: cfi
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 282 october 2010 figure 3-39. interrupt throttle flow diagram for cases where the 82598 is connected to a small number of clients, it is desirable to initialize the interrupt as soon as possible with minimum latency. for these cases, when the eitr counter counts down to zero and no interrupt event has happened, then the eitr counter is not reset but stays at zero. thus, the next interrupt event triggers an interrupt immediately. that scenario is illustrated as case b. case a: heavy load, interrupts moderated
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 283 case b: light load, interrupts immediately on packet receive note: to ensure the interrupts rate is properly controlled by software and is not affected by eicr reads, the eitr restarts counting for the next interrupt trigger right after the interrupt trigger and does not wait for the interrupt to be cleared as it used to wait in previous devices. 3.5.4.3 clearing interrupt causes the 82598 has three methods available for to clear eicr bits: autoclear, clear-on-write, and clear-on- read. auto-clear in systems that support msi-x, the interrupt vector enables the interrupt service routine to know the interrupt cause without reading the eicr. with interrupt moderation active, software loads from spurious interrupts is minimized. in this case, the software overhead of a i/o read or write can be avoided by setting appropriate eicr bits to autoclear mode by setting the corresponding bits in the extended interrupt auto-clear (eiac) register. when auto-clear is enabled for a interrupt cause, the eicr bit is set when a cause event occurs. when the eitr counter reaches zero, the msi-x message is sent on pcie. then the eicr bit is cleared and enabled to be set by a new cause event. the vector in the msi-x message signals software the cause of the interrupt to be serviced. it is possible that in the time after the eicr bit is cleared and the interrupt service routine services the cause, for example checking the transmit and receive queues, that another cause event occurs that is then serviced by this isr call, yet the eicr bit remains set. this results in a spurious interrupt. software can detect this case if there are no entries that require service in the transmit and receive queues, and exit knowing that the interrupt has been automatically cleared. the use of interrupt moderations through the eitr register limits the extra software overhead that can be caused by these spurious interrupts. write to clear the eicr register clears specific interrupt cause bits in the register after writing 1b to those bits. any bit that was written with a 0b remains unchanged. read to clear all bits in the eicr register are cleared on a read to eicr if gpie.ocd is not set. if set, only the other causes bits are cleared on read. 3.5.4.4 dynamic interrupt moderation there are some types of network traffic for which latency is a critical issue. for these types of traffic, interrupt moderation hurts performance by increasing latency between when a packet is received by hardware and when it is indicated to the host operating system. this traffic can be identified by the tcp port value, in conjunction with control bits, size, and vlan priority.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 284 october 2010 the 82598 implements eight entries, software programmable, table of tcp ports and eight registers with control bits filter and size threshold. in addition, a dedicated register enables setting of vlan priority threshold. if a packet is received on one of these tcp ports, and the conditions set by the register fit to the packet, hardware should interrupt immediately, overriding the interrupt moderation by the eitr counter. a port enabling bit allows enabling or disabling of a specific port for this purpose. 3.5.4.4.1 implementation the logic of the dynamic interrupt moderation is as follows: ? there are eight port filters. each filter checks the value of incoming packets tcp port, size and control bits, against values stored in filter's register. each parameter can be bypassed (or wild carded). each filter can be enabled or disabled. if one of the filters detects an adequate packet, an immediate interrupt is issued. ? when vlan priority filtering is enabled, vlan packets trigger an immediate interrupt when the vlan priority is equal to or above the vlan priority threshold. this is regardless of the status of the port filters. note that eitr is reset to 0b following a dynamic interrupt. note: packets that are dropped or have errors do not cause an immediate interrupt. 3.5.4.5 tcp timer interrupt in order to implement tcp timers for i/oat, software needs to take action periodically (every 10 ms). the software device driver must rely on software-based timers, whose granularity can change from platform to platform. this software timer generates a software nic interrupt, which then enables the software device driver to perform timer functions as part of its usual dpc, avoiding cache thrash and enabling parallelization. the timer interval is system-specific. the software device driver programs a timeout value (usual value of 10 ms), and each time the timer expires, hardware sets a specific bit in the eicr. when an interrupt occurs (due to normal interrupt moderation schemes), software reads the eicr and discovers that it needs to process timer events during that dpc. the timeout should be programmable by the software device driver, and it should be able to disable the timer interrupt if it is not needed. 3.5.4.5.1 description a stand-alone down-counter is implemented. an interrupt is issued each time the value of the counter is zero. software is responsible for setting the initial value for the timer in the duration field. kick-starting is done by writing 1b to the kickstart bit. following kick-starting, an internal counter is set to the value defined by the duration field. then the counter is decreased by one each ms. when the counter reaches zero, an interrupt is issued. the counter re-starts counting from its initial value if the loop field is set. 3.5.4.6 msi-x interrupts msi-x defines a separate optional extension to basic msi functionality. compared to msi, msi-x supports a larger maximum number of vectors per function, the ability for software to control aliasing when fewer vectors are allocated than requested, plus the ability for each vector to use an independent
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 285 address and data value, specified by a table that resides in memory space. however, most of the other characteristics of msi-x are identical to those of msi. for more information on msi-x, refer to the pci local bus specification, revision 3.0. msi-x maps each of the 82598 interrupt causes into an interrupt vector that is conveyed by the 82598 as a posted-write pcie transaction. mapping of an interrupt cause into an msi-x vector is determined by system software (device driver) through a translation table stored in the msi-x allocation registers. each entry of the allocation registers define the vector for a single interrupt cause. table 3-77 lists which interrupt cause is represented by each entry in the msi-x allocation registers. table 3-77. interrupt cases for msi-x each msi-x interrupt vector has some attributes assigned to it, such as the address and data for its posted-write message. 3.5.5 802.1q vlan support the 82598 provides several specific mechanisms to support 802.1q vlans: ? optional adding (for transmits) and ping strip (for receives) of ieee 802.1q vlan tags. ? optional ability to filter packets belonging to certain 802.1q vlans. 3.5.5.1 802.1q vlan packet format the following table compares an untagged 802.3 ethernet packet with an 802.1q vlan tagged packet: table 3-78. comparing packets interrupt entry 1 1. entry in the msi-x allocation registers. description rxq[63:0] 63:0 receive queues associates an interrupt occurring in each of the rx queues with a corresponding entry in the msi-x allocation registers. txq[31:0] 95:64 transmit queues associates an interrupt occurring in each of the tx queues with a corresponding entry in the msi-x allocation registers. tcp timer 96 tcp timer associates an interrupt issued by the tcp timer with a corresponding entry in the msi-x allocation registers other causes 97 other causes associates an interrupt issued by the other causes with a corresponding entry in the msi-x allocation registers 802.3 packet #octets 802.1q vlan packet #octets da 6 da 6 sa 6 sa 6
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 286 october 2010 note: the crc for the 802.1q tagged frame is re-computed, so that it covers the entire tagged frame including the 802.1q tag header. also, max frame size for an 802.1q vlan packet is 1522 octets as opposed to 1518 octets for a normal 802.3z ethernet packet. 3.5.5.2 802.1q tagged frames for 802.1q, the tag header field consists of four octets comprised of the tag protocol identifier (tpid) and tag control information (tci); each taking two octets. the first 16 bits of the tag header makes up the tpid. it contains the protocol type that identifies the packet as a valid 802.1q tagged packet. the two octets making up the tci contain three fields: ? user priority (up) ? canonical form indicator (cfi). should be 0b for transmits. for receives, the device has the capability to filter out packets that have this bit set. see the cfien and cfi bits in the vlnctrl. ? vlan identifier (vid) the bit ordering is as follows: 3.5.5.3 transmitting and receiving 802.1q packets since the 802.1q tag is only four bytes, adding and stripping of tags could be done completely in software. (in other words, for transmits, software inserts the tag into packet data before it builds the transmit descriptor list, and for receives, software strips the 4-byte tag from the packet data before delivering the packet to upper layer software) however, because adding and stripping of tags in software adds over-head for the host, the 82598 has additional capabilities to add and strip tags in hardware. see section 3.5.5.3.1 and section 3.5.5.3.2 . 3.5.5.3.1 adding 802.1q tags on transmits software might command the 82598 to insert an 802.1q vlan tag on a per packet basis. if the vle bit in the transmit descriptor is set to 1b, then the 82598 inserts a vlan tag into the packet that it transmits over the wire. the tpid field of the 802.1q tag comes from the vet register, and the tci of the 802.1q tag comes from the vlan field of the legacy transmit descriptor or the vlan tag field of the advanced transmit descriptor. refer to table 3-65 for more information regarding hardware insertion of tags for transmits. type/length 2 802.1q tag 4 data 46-1500 type/length 2 crc 4 data 46-1500 crc* 4 octet 1 octet 2 up vid
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 287 3.5.5.3.2 stripping 802.1q tags on receives software might instruct the 82598 to strip 802.1q vlan tags from received packets. if the vlnctrl.vme bit is set to 1b, and the incoming packet is an 802.1q vlan packet (it's ethernet type field matched the vet), then the 82598 strips the 4-byte vlan tag from the packet and stores the tci in the vlan tag field of the receive descriptor. the 82598 also sets the vp bit in the receive descriptor to indicate that the packet had a vlan tag that was stripped. if the vlnctrl.vme bit is not set, the 802.1q packets can still be received if they pass the receive filter, but the vlan tag is not stripped and the vp bit is not set. refer to table 3-79 for more information regarding receive packet filtering. 3.5.5.4 802.1q vlan packet filtering vlan filtering is enabled by setting the vlnctrl.vfe bit to 1b. if enabled, hardware compares the type field of the incoming packet to a 16-bit field in the vlan ether type (vet) register. if the vlan type field in the incoming packet matches the vet register, the packet is then compared against the vlan filter table array for acceptance. the virtual lan id field indexes a 4096-bit vector. if the indexed bit in the vector is one; there is a virtual lan match. software might set the entire bit vector to ones if the node does not implement 802.1q filtering. the 4096-bit vector is comprised of 128, 32-bit registers. matching to this bit vector follows the same algorithm as for multicast address filtering. the vlan identifier (vid) field consists of 12 bits. the upper seven bits of this field are decoded to determine the 32-bit register in the vlan filter table array to address and the lower five bits determine which of the 32 bits in the register to evaluate for matching. two other bits in the vlnctrl register, cfien and cfi, are also used in conjunction with 802.1q vlan filtering operations. cfien enables the comparison of the value of the cfi bit in the 802.1q packet to the receive control register cfi bit as acceptance criteria for the packet. note: the vfe bit does not effect whether the vlan tag is stripped. it only effects whether the vlan packet passes the receive filter. table 3-79 lists reception actions per control bit settings.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 288 october 2010 table 3-79. packet reception decision table note: a packet is defined as a vlan/802.1q packet if its type field matches the vet. 3.5.6 dca 3.5.6.1 description direct cache access (dca) is a method to improve network i/o performance by placing some posted inbound writes directly within cpu cache. dca potentially eliminates cache misses due to inbound writes. is packet 802.1q? vlnctrl. vme vlnctrl. vfe action no x x normal packet reception yes 0b 0b receive a vlan packet if it passes the standard mac address filters (only). leave the packet as received in the data buffer. vp bit in receive descriptor is cleared. yes 0b 1b receive a vlan packet if it passes the standard filters and the vlan filter table. leave the packet as received in the data buffer (the vlan tag would not be stripped). vp bit in receive descriptor is cleared. yes 1b 0b receive a vlan packet if it passes the standard filters (only). strip off the vlan information (four bytes) from the incoming packet and store in the descriptor. sets vp bit in receive descriptor. yes 1b 1b receive a vlan packet if it passes the standard filters and the vlan filter table. strip off the vlan information (four bytes) from the incoming packet and store in the descriptor. sets vp bit in receive descriptor.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 289 figure 3-40. dca implementation on fsb system as figure 3-40 illustrates, dca provides a mechanism where the posted write data from an i/o device, such as an ethernet nic, can be placed into cpu cache with a hardware pre-fetch. this mechanism is initialized at power-on reset. a software device driver for the i/o device configures the i/o device for dca and sets up the appropriate cpu id and bus id for the device to send data. the device then encapsulates that information in pcie tlp headers, in the tag field, to trigger a hardware pre-fetch by the mch to the cpu cache. dca implementation is controlled by separated registers (dca_rxctrl and dca_txctrl) the assignment of receive queues to dca_rxctl is described in section 3.5.2 , the assignment of transmit queues to dca_txctl is described in the following ? dca_txctrl0 is assigned to transmit queues 0 to 16. dca_txctrl1 is assigned to transmit queues 1 to 17 ? dca_txctrl15 is assigned to transmit queues 15 to 31. in addition, a dca_id register can be found for each port, in order to make visible the function, device, and bus numbers to the software device driver. the dca_rxctrl and dca_txctrl registers can be written by software on the fly and can be changed at any time. when software changes the register contents, hardware applies changes only after all the previous packets in progress for dca has completed. the dca implemented in the 82598 makes use of the mwr method (as opposed to vdm method). this way, it is consistent with both generations for ioh/mch. however, in order to implement dca, the 82598 has to be aware of the data movement engine version used (dme1/dme2). the software device driver initializes the 82598 to be aware of the bus configuration. a new register named dca_ctrl is used in order to properly define the system configuration. there are two modes for dca implementation: 1. dme1: the dca target id is derived from cpu id 2. dme2: the dca target id is derived from apic id.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 290 october 2010 the software device driver selects one of these modes through the dca_mode register. both modes are described in the sections that follow. 3.5.6.2 pcie message format for dca (mwr mode) figure 3-41 shows the format of the pcie message for dca. figure 3-41. pcie message format for dca the dca preferences field has the following formats. for fsb chipset: for csi chipset: bits name description 0 dca indication 0b = dca disabled 1b = dca enabled 4:1 dca target id the dca target id specifies the target cache for the data. bits name description 4:0 dca target id 11111b: dca is disabled other: target core id derived from apic id. the method for this is described in the dca platform architecture specification.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 291 note: all functions within the 82598 have to adhere to the tag encoding rules for dca writes. even if a given function is not capable of dca, but other functions are capable of dca, memory writes from the non-dca function must set the tag field to 11111b. 3.5.7 led's the 82598 implements four output drivers intended for driving external led circuits per port. each of the four led outputs can be individually configured to select the particular event, state, or activity, which is indicated on that output. in addition, each led can be individually configured for output polarity as well as for blinking versus non-blinking (steady-state) indication. the configuration for led outputs is specified via the ledctl register. in addition, the hardware-default configuration for all led outputs can be specified via eeprom fields thereby supporting led displays configurable to a particular oem preference. each of the four led's can be configured to use one of a variety of sources for output indication. the ivrt bits enable the led source to be inverted before being output or observed by the blink-control logic. led outputs are assumed to normally be connected to the negative side (cathode) of an external led. the blink bits control whether the led should be blinked (on for 200 ms, then off for 200 ms) while the led source is asserted. note that you must have link in order for the leds to blink. to ensure you have link, set the force link up (flu) bit when you want to blink the leds. when you want to stop blinking, reset the flu bit to 0b. the blink control can be especially useful for ensuring that certain events, such as activity indication, cause led transitions, which are sufficiently visible by a human eye. note: the link/activity source functions slightly different from the others when blink is enabled. the led is off if there is no link, on if there is link and no activity, and blinking if there is link and activity.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 292 october 2010 note: this page intentionally left blank.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 293 4. programming interface 4.1 address regions the 82598?s address space is mapped into four regions along with the pci base address registers. these regions are listed in table 4-1 . table 4-1. address regions both the flash and expansion rom base address registers map the same flash memory. the internal registers, memories and flash are be accessed though i/o space by doing a level of indirection. 4.2 memory-mapped access 4.2.1 memory-mapped access to internal registers and memories internal registers and memories are be accessed as direct memory-mapped offsets from the base address register (bar0 or bar0/bar1). see section 4.4 for the appropriate offset for each internal register. 4.2.2 memory-mapped accesses to flash external flash is accessed using direct memory-mapped offsets from the flash base address register (bar1 or bar2/bar3). flash is only accessible if enabled through the eeprom initialization control word, and if the flash base address register contains a valid (non-zero) base memory address. for accesses, the offset from the flash bar corresponds to the offset into the flash?s actual physical memory space. addressable content mapping style region size internal registers and memories direct memory mapped 128 kb flash (optional) direct memory-mapped 64-512 kb expansion rom (optional) direct memory-mapped 64-512 kb internal registers and memories, flash (optional) i/o window mapped 32 bytes msi-x (optional) direct memory mapped 16 kb
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 294 october 2010 4.2.3 memory-mapped access to expansion rom external flash can also be accessed as a memory-mapped expansion rom. accesses to offsets starting from the expansion rom base address reference the flash provided that access is enabled through the eeprom initialization control word and if the expansion rom base address register contains a valid (non-zero) base memory address. 4.3 i/o-mapped access all internal registers, memories, and flash can be accessed using i/o operations. i/o accesses are supported only if an i/o base address is allocated and mapped (bar2 or bar4), the bar contains a valid value, and i/o address decoding is enabled in pcie configuration. when an i/o bar is mapped, the i/o address range allocated opens a 32-byte window in the system i/0 address map. within this window, two i/o addressable register are implemented: ioaddr and iodata. the ioaddr register is used to specify a reference to an internal register, memory, or flash; iodata register is used as a window to the register, memory or flash address specified by ioaddr. 4.3.1 ioaddr (i/o offset 0x00, rw) ioaddr must always be written as a dword access. writes that are less than 32 bits are ignored. reads of any size return a dword; however, the chipset or cpu might only return a subset of that dword. for software programmers, the in and out instructions must be used to cause i/o cycles to be used on the pcie bus. because writes must be to 32-bit, the source register of out must be eax (the only 32- bit register supported by the out command). for reads, the in instruction can have any size target register, but we recommended eax be used. because only a particular range is addressable, the upper bits of this register are hard coded to zero. bits 31 through 20 are not write-able and always read back as 0b. on hardware reset (internal power on reset or lan_pwr_good) or pci reset, this register value resets to 0x00000000. once written, the value is retained until the next write or reset. 4.3.2 iodata (i/o offset 0x04, rw) iodata must always be written as a dword access when the ioaddr register contains a value for internal registers and memories (such as 0x00000-0x1fffc). writes less than 32 bits are ignored. offset abbreviation name rw size 0x00 ioaddr internal register, internal memory, or flash location address. 0x00000-0x1ffff ? internal registers/memories 0x20000-0x7ffff ? undefined 0x80000-0xfffff ? flash rw 4 bytes 0x04 iodata data field for reads or writes to the internal register, internal memory, or flash location as identified by the current value in ioaddr. all 32 bits of this register have read/write capability. rw 4 bytes 0x08-0x1f reserved reserved o 4 bytes
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 295 the iodata register can be written as a byte, word, or dword access when the register contains a value for flash (such as 0x80000-0xfffff). in this case, the iodata value must be properly aligned to the data value. additionally, the lower 2 bits of the iodata pci-x access must correspond to the byte, word, or dword access. the following table lists the supported configurations. software might have to implement non-obvious code to access the flash at a byte or word at a time. example code that reads a flash byte is shown: char *ioaddr; char *iodata; ioaddr = iobase + 0; iodata = iobase + 4; *(ioaddr) = flash_byte_address; read_data = *(iodata + (flash_byte_address % 4)); reads to iodata of any size return a dword; however, the chipset or cpu might only return a subset of that dword. for software programmers, the in and out instructions must be used to cause i/o cycles to be used on the pcie bus. where 32-bit quantities are required on writes, the source register of out must be eax (the only 32-bit register supported). writes and reads to iodata when the ioaddr register value is in an undefined range (0x20000- 0x7fffc) should not be performed. results cannot be determined. note: there are no special software timing requirements for accesses to ioaddr or iodata. all accesses are immediate except when data is not readily available or acceptable. in this case, the 82598 delays results through normal bus methods (such as split transaction or transaction retry). because a register/memory/flash read or write takes two i/o cycles, software must guarantee that the two i/o cycles occur as an atomic operation. otherwise, results can be non-deterministic from a software viewpoint. 4.3.3 undefined i/o offsets i/o offsets 0x08 through 0x1f are considered to be reserved offsets with the i/o window. dword reads from these addresses returns 0xffff; writes are discarded. table 4-2. supported iodata configurations access type ioaddr register bits [1:0] target iodata access be[3:0]# bits in data phase byte (8 bit) 00b 1110b 01b 1101b 10b 1011b 11b 0111b word (16 bit) 00b 1100b 10b 0011b dword (32 bit) 00b 0000b
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 296 october 2010 4.4 device registers 4.4.1 terminology 4.4.2 register list the 82598's non-pcie configuration registers are listed in table 4-3 . these registers are ordered by group and are not necessarily listed in the order that they appear in address space. all registers should be accessed as a 32-bit width on reads with an appropriate software mask. software read/modify/write mechanism should be invoked for partial writes. shorthand description r/w read/write. a register with this attribute can be read and written. if written since reset, the value read reflects the value written. r/w s read/write status. a register with this attribute can be read and written. this bit represents status of some sort, so the value read may not reflect the value written. ro read only. if a register is read only, writes to this register have no effect. wo write only. reading this register may not return a meaningful value. r/wc read/write clear. a register bit with this attribute can be read and written. however, a write of a 1b clears (sets to 0b) the corresponding bit and a write of a 0b has no effect. r/clr read clear. a register bit with this attribute is cleared after read. writes have no effect on the bit value. r/w sc read/write self clearing. when written to a 1b the bit causes an action to be initiated. once the action is complete, the bit returns to 0b. ro/lh read only, latch high. the bit records an event or the occurrence of a condition to be recorded. when the event occurs the bit is set to 1b. after the bit is read, it returns to 0b unless the event is still occurring. ro/ll read only, latch low. the bit records an event. when the event occurs the bit is set to 0b. after the bit is read, it reflects the current status. rw0 ignore read, write zero. the bit is a reserved bit. any values read should be ignored. when writing to this bit always write a 0b. rwp ignore read, write preserving. this bit is a reserved bit. any values read should be ignored. however, they must be saved. when writing the register the value read out must be written back. (there are currently no bits that have this definition.)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 297 table 4-3. register list category offset abbreviation register name rw page general 0x00000 - 0x00004 ctrl device control rw 304 general 0x00008 status device status ro 305 general 0x00018 ctrl_ext extended device control rw 305 general 0x0020 esdp extended sdp control rw 306 general 0x0028 eodsdp extended od sdp control rw 307 general 0x00200 ledctl led control rw 308 general 0x0004c tcptimer tcp timer rw 310 nvm 0x10010 eec eeprom/flash control rw 310 nvm 0x10014 eerd eeprom read rw 313 nvm 0x1001c fla flash access rw 313 nvm 0x10110 eemngctl manageability eeprom control rw 314 nvm 0x10114 eemngdata manageability eeprom read/write data rw 315 nvm 0x10118 flmngctl manageability flash control rw 315 nvm 0x1011c flmngdata manageability flash read data rw 315 nvm 0x10120 flmngcnt manageability flash read counter rw 316 nvm 0x1013c flop flash opcode rw 316 nvm 0x10200 grc general receive control rw 317 interrupt 0x00800 eicr extended interrupt cause read r/c 317 interrupt 0x00808 eics extended interrupt cause set wo 319 interrupt 0x00880 eims extended interrupt mask set/read rws 319 interrupt 0x00888 eimc extended interrupt mask clear wo 320 interrupt 0x00810 eiac extended interrupt auto clear rw 321 interrupt 0x00890 eiam extended interrupt auto mask enable rw 322 interrupt 0x00820 - 0x0086c eitr extended interrupt throttling rate 0 - 19 rw 322 interrupt 0x00900- 0x00960 ivar interrupt vector allocation registers rw 323 interrupt bar3/ 0x0000 - 0x013c msixt[19:0] msi-x table rw 324 interrupt bar3/ 0x2000 msixpba msi-x pending bit array ro 324
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 298 october 2010 interrupt 0x11068 pbacl msi-x pba clear rw 324 interrupt 0x00898 gpie general purpose interrupt enable rw 325 flow control 0x03008 pfctop priority flow control type opcode rw 326 flow control 0x03200 ? 0x0320c fcttv[0-3] flow control transmit timer value rw 326 flow control 0x03220 + n*0x8 fcrtl[0-7] flow control receive threshold low rw 326 flow control 0x03260 + n*0x8 fcrth[0-7] flow control receive threshold high rw 327 flow control 0x032a0 fcrtv flow control refresh threshold value rw 328 flow control 0x0ce00 tfcs transmit flow control status ro 328 receive dma 0x01000+ n*0x40 rdbal[0-63] rx descriptor base low rw 329 receive dma 0x01004+ n*0x40 rdbah[0-63] rx descriptor base high rw 329 receive dma 0x01008+ n*0x40 rdlen[0-63] rx descriptor length rw 329 receive dma 0x01010+ n*0x40 rdh[0-63] rx descriptor head ro 329 receive dma 0x01018+ n*0x40 rdt[0-63] rx descriptor tail rw 330 receive dma 0x01028+ n*0x40 rxdctl[0-63] receive descriptor control rw 330 receive dma 0x02100 ? 0x0213c srrctl[0-15] split receive control rw 332 receive dma 0x02200 ? 0x0223c dca_rxctrl [0-15] rx dca control rw 332 receive dma 0x02f00 rdrxctl receive dma control rw 333 receive dma 0x03c00 ? 0x03c1c rxpbsize receive packet buffer size rw 334 receive dma 0x03000 rxctrl receive control rw 334 receive dma 0x03d04 ? 0x03d08 dropen drop enable control rw 335 receive 0x05000 rxcsum receive checksum control rw 335 receive 0x05008 rfctl receive filter control rw 336 receive 0x05200- 0x053fc mta[127:0] multicast table array (n) rw 336 receive 0x05400 ral(0) receive address low (0) rw 337 receive 0x05404 rah(0) receive address high (0) rw 337
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 299 ?? ? ? receive 0x05478 ral(15) receive address low (15) rw 337 receive 0x0547c rah(15) receive address high (15) rw 337 receive 0x05480 ? 0x054bc psrtype packet split receive type rw 338 receive 0x0a000- 0x0a9fc vfta vlan filter table array rw 339 receive 0x05080 fctrl filter control rw 341 receive 0x05088 vlnctrl vlan control rw 343 receive 0x05090 mcstctrl multicast control rw 343 receive 0x05818 mrqc multiple receive queues command rw 343 receive 0x0581c vmd_ctl vmdq control rw 344 receive 0x05a80 - 0x05a9c imir immediate interrupt rx [7:0] rw 344 receive 0x05aa0 - 0x05abc imirext immediate interrupt rx extended[0-7] rw 345 receive 0x05ac0 imirvp immediate interrupt rx vlan priority rw 345 receive 0x05c00- 0x05c3f reta redirection table rw 346 receive 0x05c80- 0x05caf rssrk rss random key register rw 347 transmit 0x06000+ n*0x40 tdbal[0-31] tx descriptor base low rw 347 transmit 0x06004+ n*0x40 tdbah[0-31] tx descriptor base high rw 348 transmit 0x06008+ n*0x40 tdlen[0-31] tx descriptor length rw 348 transmit 0x06010+ n*0x40 tdh[0-31] tx descriptor head ro 348 transmit 0x06018+ n*0x40 tdt[0-31] tx descriptor tail rw 348 transmit 0x06028+ n*0x40 txdctl[0-31] transmit descriptor control rw 349 transmit 0x06038+ n*0x40 tdwbal[0-31] transmit descriptor write back address low rw 350 transmit 0x0603c+n* 0x40 tdwbah[0-31] transmit descriptor write back address high rw 350 transmit 0x07e00 dtxctl dma tx control rw 350 transmit 0x07200 ? 0x0723c dca_txctrl[0-15] tx dca ctrl register rw 390
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 300 october 2010 transmit 0x0cb00 tipg transmit ipg control rw 351 transmit 0x0cc00 ? 0x0cc1c txpbsize transmit packet buffer size rw 352 transmit 0x0cd10 mngtxmap manageability transmit tc mapping rw 352 wake 0x05800 wuc wake up control rw 352 wake 0x05808 wufc wake up filter control rw 353 wake 0x05810 wus wake up status ro 353 wake 0x05838 ipav ip address valid rw 354 wake 0x05840- 0x05858 ip4at ipv4 address table rw 355 wake 0x05880- 0x0588f ip6at ipv6 address table rw 355 wake 0x05900 wupl wake up packet length rw 356 wake 0x05a00- 0x05a7c wupm wake up packet memory r 356 wake 0x09000- 0x093fc fhft flexible host filter table rw 356 statistics 0x04000 crcerrs crc error count ro 358 statistics 0x04004 illerrc illegal byte error count ro 358 statistics 0x04008 errbc error byte count ro 358 statistics 0x04010 mspdc mac short packet discard count ro 358 statistics 0x03fa0 ? 0x03fbc mpc missed packets count[0-7] ro 359 statistics 0x04034 mlfc mac local fault count ro 359 statistics 0x04038 mrfc mac remote fault count ro 359 statistics 0x04040 rlec receive length error count ro 359 statistics 0x03f60 lxontxc link xon transmitted count ro 359 statistics 0x0cf60 lxonrxc link xon received count ro 360 statistics 0x03f68 lxofftxc link xoff transmitted count ro 360 statistics 0x0cf68 lxoffrxc link xoff received count ro 360 statistics 0x03f00 ? 0x03f1c pxontxc priority xon transmitted count[0-7] ro 360 statistics 0x0cf00 ? 0x0cf1c pxonrxc priority xon received count[0-7] ro 360 statistics 0x03f20 ? 0x03f3c pxofftxc priority xoff transmitted count[0-7] ro 361
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 301 statistics 0x0cf20 ? 0x0cf3c pxoffrxc priority xoff received count[0-7] ro 361 statistics 0x0405c prc64 packets received (64 bytes) count ro 361 statistics 0x04060 prc127 packets received (65-127 bytes) count ro 361 statistics 0x04064 prc255 packets received (128-255 bytes) count ro 362 statistics 0x04068 prc511 packets received (256-511 bytes) count ro 362 statistics 0x0406c prc1023 packets received (512-1023 bytes) count ro 362 statistics 0x04070 prc1522 packets received (1024-1522 bytes) ro 362 statistics 0x04074 gprc good packets received count ro 363 statistics 0x04078 bprc broadcast packets received count ro 363 statistics 0x0407c mprc multicast packets received count ro 363 statistics 0x04080 gptc good packets transmitted count ro 363 statistics 0x0408c gorc good octets received count ro 364 statistics 0x04094 gotc good octets transmitted count ro 364 statistics 0x03fc0 ? 0x03fdc rnbc receive no buffers count[0-7] ro 364 statistics 0x040a4 ruc receive undersize count ro 365 statistics 0x040a8 rfc receive fragment count ro 365 statistics 0x040ac roc receive oversize count ro 365 statistics 0x040b0 rjc receive jabber count ro 365 statistics 0x040b4 mngprc management packets receive count ro 366 statistics 0x040b8 mngpdc management packets dropped count ro 366 statistics 0x0cf90 mngptc management packets transmitted count ro 366 statistics 0x040c4 tor total octets received (high) ro 366 statistics 0x040d0 tpr total packets received ro 367 statistics 0x040d4 tpt total packets transmitted ro 367 statistics 0x040d8 ptc64 packets transmitted (64 bytes) count ro 367 statistics 0x040dc ptc127 packets transmitted (65-127 bytes) count ro 367 statistics 0x040e0 ptc255 packets transmitted (128-256 bytes) count ro 368 statistics 0x040e4 ptc511 packets transmitted (256-511 bytes) count ro 368
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 302 october 2010 statistics 0x040e8 ptc1023 packets transmitted (512-1023 bytes) count ro 368 statistics 0x040ec ptc1522 packets transmitted (1024-1522 bytes) count ro 368 statistics 0x040f0 mptc multicast packets transmitted count ro 369 statistics 0x040f4 bptc broadcast packets transmitted count ro 369 statistics 0x04120 xec xsum error count ro 369 statistics 0x02300 + n*0x4 rqsmr receive queue statistics mapping [15:0] rw 369 statistics 0x07300 + n*0x4 tqsmr transmit queue statistics mapping [7:0] rw 370 statistics 0x01030+ n*0x40 qprc queue packets received count [15:0] ro 371 statistics 0x06030 + n*0x40 qptc queue packets transmitted count [15:0] ro 371 statistics 0x01034+ n*0x40 qbrc queue bytes received count [15:0] ro 371 statistics 0x06034 + n*0x40 qbtc queue bytes transmitted count [15:0] ro 372 management filters 0x05010 ? 0x0502c mavtv[7:0] vlan tag value [7:0] rw 372 management filters 0x05030 - 0x0504c mfutp[7:0] management flex udp/tcp ports rw 372 management filters 0x05820 manc management control rw 372 management filters 0x05824 mfval manageability filters valid rw 373 management filters 0x05860 manc2h management control to host rw 374 management filters 0x05890 - 0x058ac mdef[7:0] manageability filters valid rw 374 management filters 0x058b0 - 0x058ec mipaf manageability ip address filter rw 376 management filters 0x05910 mmal_0 manageability mac address low 0 rw 379 management filters 0x05914 mmah_0 manageability mac address high 0 rw 379 management filters 0x05928 mmal_3 manageability mac address low 3 rw 379 management filters 0x0592c mmah_3 manageability mac address high 3 rw 379 management filters 0x09400- 0x097fc ftft flexible tco filter table rw 379
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 303 pcie 0x11000 gcr pcie* control rw 381 pcie 0x11004 gtv pcie* timer value rw 383 pcie 0x11008 functag function tag rw 383 pcie 0x1100c glt pcie* latency timer rw 384 pcie 0x10150 factps function active and power state ro 384 pcie 0x11040 pcieanactl pcie* analog configuration rw 385 pcie 0x10140 swsm software semaphore rw 385 pcie 0x10148 fwsm firmware semaphore rw 386 pcie 0x10160 gssr general software semaphore register rw 387 pcie 0x11064 mrevid mirrored revision id ro 390 pcie 0x11070 dca_id dca requester id information ro 390 pcie 0x11074 dca_ctrl dca control rw 390 mac 0x04200 pcs1gcfig pcs_1g global configuration 1 rw 391 mac 0x04208 pcs1glctl pcs_1g link control rw 391 mac 0x0420c pcs1glsta pcs_1g link status ro 392 mac 0x04218 pcs1gana pcs_1g auto negotiation advanced rw 393 mac 0x0421c pcs1ganlp pcs_1g an lp ability ro 393 mac 0x04220 pcs1gannp pcs_1g an next page transmit rw 394 mac 0x04224 pcs1ganlpnp pcs_1g an lp?s next page ro 395 mac 0x04240 hlreg0 flow control 0 rw 396 mac 0x04244 hlreg1 flow control status 1 ro 397 mac 0x04248 pap pause and pace rw 398 mac 0x0424c maca mdi auto scan command and address rw 399 mac 0x04250 apae auto-scan phy address enable rw 399 mac 0x04254 ard auto-scan read data rw 399 mac 0x04258 ais auto-scan interrupt status rw 400 mac 0x0425c msca mdi signal command and address rw 400 mac 0x04260 msrwd mdi single read and write data rw 401 mac 0x04264 mladd low mac address rw 401 mac 0x04268 mhadd mac address high and maximum frame size rw 401 mac 0x04288 pcss1 xgxs status 1 ro 401
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 304 october 2010 4.4.3 register descriptions 4.4.3.1 general control registers 4.4.3.1.1 device control register ? ctrl (0x00000/0x00004, rw) mac 0x0428c pcss2 xgxs status 2 ro 402 mac 0x04290 xpcss 10gbase-x pcs status ro 402 mac 0x04298 serdesc serdes interface control rw 404 mac 0x0429c macs fifo status/control report rw 405 mac 0x042a0 autoc auto-detect control/status rw 405 mac 0x042a4 links link status ro 407 mac 0x042a8 autoc2 auto negotiation control 2 rw 408 mac 0x042ac autoc3 auto negotiation control 3 rw 409 mac 0x042b0 anlp1 auto negotiation link partner control word 1 ro 409 mac 0x042b4 anlp2 auto negotiation link partner control word 2 ro 409 mac 0x042d0 mmngc mac manageability control host-ro/ mng-rw 410 mac 0x042d4 anlpnp1 auto negotiation link partner next page 1 ro 410 mac 0x042d8 anlpnp2 auto negotiation link partner next page 2 ro 411 mac 0x04800 atlasctl core analog configuration rw 411 field bit(s) initial value description reserved 1:0 0b reserved write as 0b for future compatibility. pcie master disable 20b when set, the 82598 blocks new master requests, including manageability requests, by using this function. once no master requests are pending by using this function, the gio master enable status bit is set. lrst 3 1b link reset this bit performs a reset of the mac, pcs, and auto negotiation functions and the entire the 82598 10 gbe controller (software reset) resulting in a state nearly approximating the state following a power-up reset or internal pcie reset, except for the system pci configuration. normally 0b, writing 1b initiates the reset. this bit is self-clearing. also referred to as mac reset. reserved 25:4 0b reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 305 lrst and rst are used to globally reset the 82598 10 gbe controller. this register is provided primarily as a software mechanism to recover from an indeterminate or suspected hung hardware state. most registers (receive, transmit, interrupt, statistics, etc.) and state machines are set to their power-on reset values, approximating the state following a power-on or pci reset. however, pcie configuration registers are not reset; this leaves the 82598 mapped into system memory space and accessible by a software device driver. to ensure that a global device reset has fully completed and that the 82598 responds to subsequent accesses, programmers must wait approximately 1 ms (after setting) before checking if the bit has cleared or to access (read or write) device registers. 4.4.3.1.2 device status register ? status (0x00008; r) 4.4.3.1.3 extended device control register ? ctrl_ext (0x00018; rw) rst 26 0b device reset this bit performs a reset of the 82598, resulting in a state nearly approximating the state following a power-up reset or internal pcie reset, except for the system pci configuration. normally 0b, writing 1b initiates the reset. this bit is self- clearing. also referred to as a software reset or global reset. note: this bit does not reset the mac, pcs, or auto negotiation functions. reserved 31:27 0x0 reserved field bit(s) initial value description reserved 1:0 0b reserved read as 0b. lan id 3:2 0b lan id. provides software a mechanism to determine the device lan identifier for this mac. read as: [0,0] lan 0, [0,1] lan 1. reserved 18:4 0b reserved pcie master enable status 19 1b this is a status bit of the appropriate ctrl.gio master disable bit. 1b = associated lan function can issue master requests. 0b = associated lan function does not issue any master request and all previously issued requests are complete. reserved 31:20 0b reserved reads as 0b. field bit(s) initial value description reserved 15:0 0b reserved ns_dis 16 0b no snoop disable when set to 1b, the 82598 does not set the no-snoop attribute in any pcie packet, independent of pcie configuration and the setting of individual no- snoop enable bits. when set to 0b, behavior of no-snoop is determined by pcie configuration and the setting of individual no-snoop enable bits.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 306 october 2010 4.4.3.1.4 extended sdp control ? esdp (0x00020, rw) ro_dis 17 0b relaxed ordering disable. when set to 1b, the 82598 does not request any relaxed ordering transactions in pcie mode regardless of the state of bit 1 in the pcie command register. when this bit is clear and bit 1 of the pcie command register is set, the 82598 requests relaxed ordering transactions as described in section 4.4.3.5.8 and section 4.4.3.12.1 (per queue and per flow). reserved 27:18 0b reserved drv_load 28 0b driver loaded and the corresponding network interface is enabled. this bit should be set by the software device driver after it was loaded and cleared when it unloads or at pcie soft reset. the bmc loads this bit as an indication that the software device driver successfully loaded to it. reserved 31:29 0b reserved reads as 0b. field bit(s) initial value description sdp0_data 0 0b 1 sdp0 data value used to read (write) a value of the software-controlled i/o pin sdp0. if sdp0 is configured as an output (sdp0_iodir = 1b), this bit controls the value driven on the pin. if sdp0 is configured as an input, all reads return the current value of the pin. sdp1_data 1 0b 1 sdp1 data value used to read (write) a value of the software-controlled i/o pin sdp1. if sdp1 is configured as an output (sdp1_iodir = 1b), this bit controls the value driven on the pin. if sdp1 is configured as an input, all reads return the current value of the pin. sdp2_data 2 0b 1 sdp2 data value used to read (write) a value of software-controlled i/o pin sdp2. if sdp2 is configured as an output (sdp2_iodir = 1b), this bit controls the value driven on the pin. if sdp2 is configured as an input, all reads return the current value of the pin. sdp3_data 3 0b 1 sdp3 data value used to read (write) a value of the software-controlled i/o pin sdp3. if sdp3 is configured as an output (sdp3_iodir = 1b), this bit controls the value driven on the pin. if sdp3 is configured as an input, all reads return the current value of the pin. sdp4_data 4 0b sdp4 data value used to read (write) a value of the software-controlled i/o pin sdp4. if sdp4 is configured as an output (sdp4_iodir = 1b), this bit controls the value driven on the pin. if sdp4 is configured as an input, all reads return the current value of the pin. sdp5_data 5 0b sdp5 data value used to read (write) a value of the software-controlled i/o pin sdp5. if sdp5 is configured as an output (sdp5_iodir = 1b), this bit controls the value driven on the pin. if sdp5 is configured as an input, all reads return the current value of the pin. reserved 7:6 0x0 reserved sdp0_iodir 8 0b 1 sdp0 pin directionality controls whether or not software-controlled pin sdp0 is configured as an input or output (0b = input, 1b = output). this bit is not affected by software or system reset, only by initial power-on or direct software writes.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 307 4.4.3.1.5 extended od sdp control ? eodsdp (0x00028; rw) sdp1_iodir 9 0b 1 sdp1 pin directionality controls whether or not software-controlled pin sdp1 is configured as an input or output (0b = input, 1b = output). this bit is not affected by software or system reset, only by initial power-on or direct software writes. sdp2_iodir 10 0b 1 sdp2 pin directionality controls whether or not software-controlled pin sdp2 is configured as an input or output (0b = input, 1b = output). this bit is not affected by software or system reset, only by initial power-on or direct software writes. sdp3_iodir 11 0b 1 sdp3 pin directionality controls whether or not software-controlled pin sdp3 is configured as an input or output (0b = input, 1b = output). this bit is not affected by software or system reset, only by initial power-on or direct software writes. field bit(s) initial value description sdp4_iodir 12 0b sdp4 pin directionality controls whether or not software-controlled pin sdp4 is configured as an input or output (0b = input, 1b = output). this bit is not affected by software or system reset, only by initial power-on or direct software writes. sdp5_iodir 13 0b sdp5 pin directionality controls whether or not software-controlled pin sdp5 is configured as an input or output (0b = input, 1b = output). this bit is not affected by software or system reset, only by initial power-on or direct software writes. reserved 31:14 0x0 reserved 1. initial value can be configured using the eeprom. field bit(s) initial value description sdp6_data_in 0 0b sdp6 data in value provides the value of sdp6 (input from external pad). sdp6_data_out 1 0b sdp6 data out value used to drive the value of sdp6 (output to pad). sdp7_data_in 2 0b sdp7 data in value provides the value of sdp7 (input from external pad). sdp7_data_out 3 0b sdp7 data out value used to drive the value of sdp7 (output to pad). reserved 31:4 0x0 reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 308 october 2010 4.4.3.1.6 led control ? ledctl (0x00200; rw) field bit(s) initial value description led0_mode 3:0 0x0 1 led0 mode this field specifies the control source for the led0 output. an initial value of 0000b selects the link_up indication. reserved 4 0b 1 reserved global_blink_ mode 50b 1 global blink mode this field specifies the blink mode of all leds. 0b = blink at 200 ms on and 200 ms off. 1b = blink at 83 ms on and 83 ms off. led0_ivrt 6 0b 1 led0 invert this field specifies the polarity/inversion of the led source prior to output or blink control. 0b = do not invert led source. 1b = invert led source. led0_blink 7 0b 1 led0 blink this field specifies whether or not to apply blink logic to the (inverted) led control source prior to the led output. 0b = do not blink led output. 1b = blink led output. led1_mode 11:8 0001b 1 led1 mode this field specifies the control source for the led1 output. an initial value of 0001b selects the 10 gb/s link indication. reserved 13:12 0b 1 reserved led1_ivrt 14 0b 1 led1 invert this field specifies the polarity/inversion of the led source prior to output or blink control. 0b = do not invert led source. 1b = invert led source. led1_blink 15 1b 1 led1 blink this field specifies whether or not to apply blink logic to the (inverted) led control source prior to the led output. 0b = do not blink led output. 1b = blink led output. led2_mode 19:16 0100b 1 led2 mode. this field specifies the control source for the led2 output. an initial value of 0100b selects link/activity indication. reserved 21:20 00b 1 reserved led2_ivrt 22 0 1 led2 invert this field specifies the polarity/inversion of the led source prior to output or blink control. 0b = do not invert led source. 1b = invert led source. led2_blink 23 0 1 led2 blink this field specifies whether or not to apply blink logic to the (inverted) led control source prior to the led output. 0b = do not blink led output. 1b = blink led output.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 309 the following mapping is used to specify the led control source (mode) for each led output. note: the dynamic led modes (filter_activity, link/activity, and mac_activity) should be used with led blink mode enabled. field bit(s) initial value description led3_mode 27:24 0101b 1 led3 mode this field specifies the control source for the led3 output. an initial value of 0101b selects the 1 gb/s link indication. reserved 29:28 0b 1 reserved led3_ivrt 30 0b 1 led3 invert this field specifies the polarity/inversion of the led source prior to output or blink control. 0b = do not invert led source. 1b = invert led source. led3_blink 31 0b 1 led3 blink this field specifies whether or not to apply blink logic to the (inverted) led control source prior to the led output. 0b = do not blink led output. 1b = blink led output. 1. these bits are read from the eeprom. mode selected mode source indication 0000b link_up asserted when any speed link is established and maintained. 0001b link_10g asserted when a 10 gb/s link is established and maintained. 0010b mac_activity asserted when link is established and packets are being transmitted or received. 0011b filter_activity asserted when link is established and packets are being transmitted or received that passed mac filtering. 0100b link/activity asserted when link is established and there is no transmit or receive activity. 0101b link_1g asserted when a 1 gb/s link is established and maintained. 0110b:1101b reserved reserved 1110b led_on always asserted. 1111b led_off always de-asserted.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 310 october 2010 4.4.3.1.7 tcp_timer - tcptimer (0x0004c, rw) 4.4.3.2 eeprom/flash registers 4.4.3.2.1 eeprom/flash control register ? eec (0x10010; rw) field bit(s) initial value description duration 7:0 0x0 duration duration of the tcp interrupt interval in ms. kickstart 8 0b counter kick-start writing 1b to this bit kick-starts the counter down-count from the initial value defined in duration field. writing 0b has no effect (ws). tcpcounten 9 0b tcp count enable when 1b, tcp timer counting is enabled. when 0b, it is disabled. upon enabling, tcp counter counts from its internal state. if the internal state is equal to zero, down-count does not restart until kickstart is activated. if the internal state is not 0b, down-count continues from the internal state. this enables a pause of the counting for debug purpose. tcpcountfinish 10 0b tcp count finish this bit enables software to trigger a tcp timer interrupt, regardless of the internal state. writing 1b to this bit triggers an interrupt and resets the internal counter to its initial value. down-count does not restart until either kickstart is activated or loop is set. writing 0b to this bit has no effect (ws). loop 11 0b tcp loop when 1b, tcp counter reloads duration each time it reaches zero and goes on down-counting from this point without kick-starting. when 0b, tcp counter stops at a zero value and does not re-start until kickstart is activated. reserved 31:12 0x0 reserved field bit(s) initial value description ee_sk 0 0b clock input to the eeprom when ee_gnt is set to 1b, the ee_sk output signal is mapped to this bit and provides the serial clock input to the eeprom. software clocks the eeprom via toggling this bit with successive writes. ee_cs 1 0b chip select input to the eeprom when ee_gnt is set to 1b, the ee_cs output signal is mapped to the chip select of the eeprom device. ee_di 2 0b data input to the eeprom when ee_gnt is set to 1b, the ee_di output signal is mapped directly to this bit. software provides data input to the eeprom via writes to this bit. ee_do 3 x data output bit from the eeprom the ee_do input signal is mapped directly to this bit in the register and contains the eeprom data output. this bit is read-only from a software perspective; writes to this bit has no effect.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 311 fwe 5:4 01b flash write enable control these two bits control whether or not writes to the flash are allowed. 00b = flash erase (along with bit 31 in the fla register). 01b = flash writes disabled. 10b = flash writes enabled. 11b = not allowed. ee_req 6 0b request eeprom access software must write a 1b to this bit to get direct eeprom access. it has access when ee_gnt is set to 1b. when software completes the access, it must then write a 0b. ee_gnt 7 0b grant eeprom access when this bit is set to 1b, software can access the eeprom using the ee_sk, ee_cs, ee_di, and ee_do bits. this field is read-only. ee_pres 8 (see description) eeprom present setting this bit to 1b indicates that an eeprom is present and has the correct signature field. this field is read-only. auto_rd 9 0b eeprom auto-read done when set to 1b, this bit indicates that the auto-read by hardware from the eeprom is done. this bit is also set when the eeprom is not present or when its signature field is not valid. this field is read-only. ee_addr_size 10 0b eeprom address size this field defines the address size of the eeprom: 0b = 8- or 9-bit addresses. 1b = 16-bit address. this field is read-only. ee_size 14:11 0010b 1 eeprom size this field defines the size of the eeprom (see table 4-4 ). this field is read-only. field bit(s) initial value description pci _ana_done 15 0b pcie analog done when set to 1b, indicates that the pcie analog section read from eeprom is done. this bit is cleared when auto-read starts. this bit is also set when the eeprom is not present or when its signature field is not valid. pci _core_ done 16 0b pcie core done when set to 1b, indicates that the core analog section read from eeprom is done. this bit is cleared when auto-read starts. this bit is also set when the eeprom is not present or when its signature field is not valid. this field is read- only. note: this bit returns the relevant done indication for the function that reads the register. pci _ genarl _done 17 0b pcie general done when set to 1b, indicates that the pcie general section read from the eeprom is done. this bit is cleared when auto-read starts. this bit is also set when the eeprom is not present or when its signature field is not valid. this field is read- only.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 312 october 2010 table 4-4. eeprom sizes (bits 14:11) pci_ func_ done 18 0b pcie function done when set to 1b, indicates that the pcie function section read from eeprom is done. this bit is cleared when auto-read starts. this bit is also set when the eeprom is not present or when its signature field is not valid. this field is read- only. note : this bit returns the relevant done indication for the function that reads the register. core_ done 19 0b core done when set to 1b, indicates that the core section read from the eeprom is done. this bit is cleared when auto-read starts. this bit is also set when the eeprom is not present or when its signature field is not valid. this field is read-only. note: this bit returns the relevant done indication for the function that reads the register. core_ csr_ done 20 0b core csr done when set to 1b, indicates that the core csr section read from the eeprom is done. this bit is cleared when auto-read starts. this bit is also set when the eeprom is not present or when its signature field is not valid. this field is read- only. note : this bit returns the relevant done indication for the function that reads the register. mac_ done 21 0b mac done when set to 1b, indicates that the mac section read from the eeprom is done. this bit is cleared when auto-read starts. this bit is also set when the eeprom is not present or when its signature field is not valid. this field is read-only. note: this bit returns the relevant done indication for the function that reads the register. reserved 31:22 0x0 reserved reads as 0b. 1. these bits are read from the eeprom. field value eeprom size eeprom address size 0000b 128 bytes 1 byte 0001b 256 bytes 1 byte 0010b 512 bytes 1 byte 0011b 1 kb 2 bytes 0100b 2 kb 2 bytes 0101b 4 kb 2 bytes 0110b 8 kb 2 bytes 0111b 16 kb 2 bytes 1000b 32 kb 2 bytes 1001b:1111b reserved reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 313 this register provides software-direct access to the eeprom. software controls the eeprom by successive writes to the register. data and address information is clocked into the eeprom by software toggling the eesk bit (bit 2) of this register with ee_cs set to 1b. data output from the eeprom is latched into bit 3 of this register via the internal 62.5 mhz clock and is accessed by software via reads of this register. writes to the flash device when writes are disabled (fwe = 01b) should not be attempted. behavior after such an operation is undefined. 4.4.3.2.2 eeprom read register ? eerd (0x10014; rw) this register is used by software to read individual words in the eeprom. to read a word, software writes the address to the read address field and simultaneously writes a 1b to the start read field. the 82598 reads the word from eeprom and places it in the read data field, setting the read done field to 1b. software can poll this register, looking for a 1b in the read done field and using the value in the read data field. when this register is used to read a word from the eeprom, that word is not written to any of the 82598's internal registers even if it is normally a hardware-accessed word. 4.4.3.2.3 flash access register ? fla (0x1001c; rw) field bit(s) initial value description start 0 0b start read writing a 1b to this bit causes the eeprom to read a 16-bit word at the address stored in the ee_addr field and then stores the result in the ee_data field. this bit is self- clearing done 1 0b read done set this bit to 1b when the eeprom read completes. set this bit to 0b when the eeprom read is in progress. note that writes by software are ignored. addr 15:2 0x0 read address this field is written by software along with start read to indicate that the address of the word to read. data 31:16 0x0 read data data returned from the eeprom read. field bit(s) initial value description fl_sck 0 0b flash clock input when fl_gnt is set to 1b, the fl_sck output signal is mapped to this bit and provides the serial clock input to the flash. software clocks the flash via toggling this bit with successive writes. fl_ce 1 0b flash chip select when fl_gnt is set to 1b, the fl_ce output signal is mapped to the chip select of the flash device. software enables the flash by writing a 0b to this bit. fl_si 2 0b flash data input when fl_gnt is set to 1b, the fl_si output signal is mapped directly to this bit. software provides data input to the flash via writes to this bit.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 314 october 2010 this register provides software direct access to the flash. software can control the flash by successive writes to this register. data and address information is clocked into the flash by software toggling the fl_sck bit (0) of this register with fl_ce set to 1b. data output from the flash is latched into bit 3 of this register via the internal 125 mhz clock and can be accessed by software via reads of this register. in the 82598, the fla register is only reset at internal power on reset or lan_pwr_good (as opposed to legacy devices at software reset). 4.4.3.2.4 manageability eeprom control register ? eemngctl (0x10110; rw) this register can be read/written by manageability firmware and is read-only to host software. fl_so 3 x flash data output the fl_so input signal is mapped directly to this bit in the register and contains the flash serial data output. this bit is read-only from a software perspective. note that writes to this bit have no effect. fl_req 4 0b request flash access software must write a 1b to this bit to get direct flash access. it has access when fl_gnt is set to 1b. when software completes the access, it must then write a 0b. fl_gnt 5 0b grant flash access when this bit is set to 1b, software can access the flash using the fl_sck, fl_ce, fl_si, and fl_so bits. reserved 29:6 0b reserved reads as 0b. fl_busy 30 0b flash busy this bit is set to 1b while a write or an erase to the flash is in progress, while this bit is cleared (reads as 0b), software can access to write a new byte to the flash. note: this bit is read-only from a software perspective. fl_er 31 0b flash erase command this command is sent to the flash only if bits 5:4 of register eec are also set to 00b. this bit is auto-cleared and reads as 0b. field bit(s) initial value description addr 14:0 0x0 address this field is written by manageability along with start read or start write to indicate which eeprom address to read or write. start 15 0b start writing a 1b to this bit causes the eeprom to start the read or write operation according to the write bit. write 16 0b write this bit signals the eeprom if the current operation is read or write. 0b = read. 1b = write. eebusy 17 0b eprom busy this bit indicates that the eeprom is busy processing an eeprom transaction and should not be accessed.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 315 4.4.3.2.5 manageability eeprom read/write data ? eemngdata (0x10114; rw) this register can be read/written by manageability firmware and is read-only to host software. 4.4.3.2.6 manageability flash control register ? flmngctl (0x10118; rw) this register can be read/written by manageability firmware and is read-only to host software. cfg_done 18 0b manageability configuration cycle is complete this bit indicates that the manageability configuration cycle (configuration of pcie and core) is complete. this bit is set to 1b by manageability firmware to indicate configuration is complete and cleared by hardware on any of the reset sources that caused the firmware to initialize the phy. writing a 0b by firmware does not affect the state of this bit. note: software should not try to access the phy for configuration before this bit is set. reserved 30:19 0x0 reserved done 31 1b transaction done this bit is cleared after the start write or start read bit is set by manageability and is set back again when the eeprom write or read transaction completes. field bit(s) initial value description wrdata 15:0 0x0 write data data to be written to the eeprom. rddata 31:16 x read data data returned from the eeprom read. note: this field is read only. field bit(s) initial value description addr 23:0 0x0 address this field is written by manageability along with start read or start write to indicate which flash address to read or write. cmd 24:25 00b command indicates which command should be executed. valid only when the cmdv bit is set. 00b = read command. 01b = write command. 10b = sector erase. note: sector erase is applicable only for atmel* flashes. 11b = erase. cmdv 26 0b command valid when set, indicates that the manageability firmware issues a new command and is cleared by hardware at the end of the command. flbusy 27 0b flash busy this bit indicates that the flash is busy processing a flash transaction and should not be accessed.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 316 october 2010 4.4.3.2.7 manageability flash read data ? flmngdata (0x1011c; rw) this register can be read/written by manageability firmware and is read-only to host software. 4.4.3.2.8 manageability flash read counter ? flmngcnt (0x10120; rw) this register can be read/written by manageability firmware and is read-only to host software. 4.4.3.2.9 flash opcode register ? flop (0x01013c; rw) this register enables the host or firmware to define the op-code used in order to erase a sector of the flash or erase the entire flash. this register is reset only at power on or during internal power on reset or lan_pwr_good. note: default values are applicable to atmel* serial flash memory devices. reserved 29:28 00b reserved done 30 1b read done this bit clears after the cmdv bit is set by manageability and is set back again when a flash single-read transaction completes. when reading a burst transaction, this bit is cleared each time manageability reads flmngrddata. wrdone 31 1b global done this bit clears after the cmdv bit is set by manageability and is set back again when all flash transactions complete. for example, the flash device finished reading all the requested read or other accesses (write and erase). field bit(s) initial value description data 31:0 0x0 read/write data on a read transaction, this register contains the data returned from the flash read. on write transactions, bits 7:0 are written to the flash. field bit(s) initial value description abort 31 0b abort writing a 1b to this bit aborts the current burst read operation. it is also self-cleared by the flash interface block when the abort command executed. reserved 30:25 0x0 reserved rdcnt 24:0 0x0 read counter this counter holds the size of the flash burst read in dwords.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 317 4.4.3.2.10 general receive control ? grc (0x10200; rw) 4.4.3.3 interrupt registers 4.4.3.3.1 extended interrupt cause register eicr (0x00800, rc) field bit(s) initial value description serase 7:0 0x52 flash block erase instruction the op-code for the flash block erase instruction and is relevant only to flash access by manageability. derase 15:8 0x62 flash device erase instruction the op-code for the flash erase instruction. reserved 31:16 0x0 reserved field bit(s) initial value description mng_en 0 1b 1 1. loaded from the eeprom. manageability enable this read-only bit indicates whether or not manageability functionality is enabled. apme 1 0b 1 advance power management enable if set to 1b, manageability wakeup is enabled. the 82598 sets the pme_status bit in the power management control/status register (pmcsr), asserts gio_wake_n when manageability wakeup is enabled, and when it receives a matching magic packet. it is a single read/write bit in a single register, but has two values depending on the function that accesses the register. reserved 31:2 0x0 reserved field bit(s) initial value description rtxq 15:0 0x0 receive/transmit queue interrupts one bit per queue or a bundle of queues, activated on receive/transmit queue events for the corresponding bit, such as: ? receive descriptor write back ? receive descriptor minimum threshold hit ? transmit descriptor write back the mapping of actual queue the appropriate rtxq bit is according to the ivar registers. reserved 19:16 0x0 reserved lsc 20 0b link status change this bit is set each time the link status changes (either from up to down or from down to up). reserved 21 0b reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 318 october 2010 this register contains frequent interrupt conditions applicable to the 82598. each time an interrupt- causing event occurs, the corresponding interrupt bit is set. an interrupt is generated each time one of the bits in this register is set and the corresponding bit is enabled using the extended interrupt mask set/read register. an interrupt can be delayed by selecting a bit in the interrupt throttling register. note: the software device driver cannot determine the interrupt cause by using the rxq and txq bits: ? receive descriptor write back, receive queue full, receive descriptor minimum threshold hit, dynamic interrupt moderation for rx. ? transmit descriptor write back. writing 1b to any bit in the register clears that bit. writing a 0b to any bit has no effect on that bit. all register bits are cleared on a register read if gpie.ocd bit is cleared; if gpie.ocd bit is set, then only bits 29:20 are cleared. auto-clear can be enabled for any or all of the bits in this register. mng 22 0b manageability event detected indicates that a manageability event happened. when the 82598 is in power down mode, the bmc might generate a pme for the same events that would cause an interrupt when the 82598 is in the d0 state. reserved 23 0b reserved gpi_sdp0 24 0b general purpose interrupt on sdp0 if gpi interrupt detection is enabled on this pin (via gpie), this interrupt cause is set when the sdp0 is sampled high. gpi_sdp1 25 0b general purpose interrupt on sdp1 if gpi interrupt detection is enabled on this pin (via gpie), this interrupt cause is set when the sdp1 is sampled high. gpi_sdp2 26 0b general purpose interrupt on sdp2 if gpi interrupt detection is enabled on this pin (via gpie), this interrupt cause is set when the sdp2 is sampled high. gpi_sdp3 27 0b general purpose interrupt on sdp3 if gpi interrupt detection is enabled on this pin (via gpie), this interrupt cause is set when the sdp3 is sampled high. pbur 28 0b rx/tx packet buffer unrecoverable error this bit is set when an unrecoverable error is detected in the packet buffer memory for rx or tx packet. dher 29 0b rx/tx descriptor handler error this bit is set when an unrecoverable error is detected in the descriptor handler memory for rx or tx descriptors. tcp timer 30 0b tcp timer expired activated when the tcp timer reaches its terminal count. reserved 31 0b reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 319 4.4.3.3.2 extended interrupt cause set register eics (0x00808, wo) software uses this register to set an interrupt condition. any bit written with a 1b sets the corresponding bit in the extended interrupt cause register (see section 4.4.3.3.1 ) and clears the relevant eitr register if gpie.eimen is set. an immediate interrupt is then generated if a bit in this register is set and the corresponding interrupt is enabled using the extended interrupt mask set/read register. if gpie.eimen is not set, then an interrupt generated by setting a bit in this register waits for eitr expiration. note: bits written with 0b are unchanged. 4.4.3.3.3 extended interrupt mask set/read register eims (0x00880, rws) field bit(s) initial value description rtxq 15:0 0x0 set corresponding eicr rtxq interrupt condition. reserved 19:16 0x0 reserved lsc 20 0b set link status change interrupt. reserved 21 0b reserved mng 22 0b set manageability event interrupt. reserved 23 0b reserved gpi_sdp0 24 0b set general purpose interrupt on sdp0. gpi_sdp1 25 0b set general purpose interrupt on sdp1. gpi_sdp2 26 0b set general purpose interrupt on sdp2. gpi_sdp3 27 0b set general purpose interrupt on sdp3. pbur 28 0b set rx/tx packet buffer unrecoverable error interrupt. dher 29 0b set rx/tx descriptor handler error interrupt. tcp timer 30 0b set corresponding eicr tcp timer interrupt condition. reserved 31 0b reserved field bit(s) initial value description rtxq 15:0 0x0 mask bit for corresponding eicr rtxq interrupt condition. reserved 19:16 0x0 reserved lsc 20 0b mask link status change interrupt. reserved 21 0b reserved mng 22 0b mask manageability event interrupt.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 320 october 2010 reading this register reveals which bits have an interrupt mask set. an interrupt in eicr is enabled if its mask bit is set to 1b and disabled if its mask bit is set to 0b. a pci interrupt is generated each a bit in this register is set and the corresponding interrupt occurs (subject to throttling). the occurrence of an interrupt condition is reflected by having a bit set in the extended interrupt cause read register (see section 4.4.3.3.1 ). an interrupt might be enabled by writing a 1b to the corresponding mask bit location (as defined in the eicr register) in this register. bits written with a 0b are unchanged. thus, if software needs to disable a particular interrupt condition (previously enabled), it must write to the extended interrupt mask clear register, rather than writing a 0b to a bit in this register. 4.4.3.3.4 extended interrupt mask clear register eimc (0x00888, wo) reserved 23 0b reserved gpi_sdp0 24 0b mask general purpose interrupt on sdp0. gpi_sdp1 25 0b mask general purpose interrupt on sdp1. gpi_sdp2 26 0b mask general purpose interrupt on sdp2. gpi_sdp3 27 0b mask general purpose interrupt on sdp3. pbur 28 0b mask rx/tx packet buffer unrecoverable error interrupt. dher 29 0b mask rx/tx descriptor handler error interrupt. tcp timer 30 0b mask bit for corresponding eicr tcp timer interrupt condition. reserved 31 0b reserved field bit(s) initial value description rtxq 15:0 0x0 mask bit for corresponding eicr rtxq interrupt condition. reserved 19:16 0x0 reserved lsc 20 0b mask link status change interrupt. reserved 21 0b reserved mng 22 0b mask manageability event interrupt. reserved 23 0b reserved gpi_sdp0 24 0b mask general purpose interrupt on sdp0. gpi_sdp1 25 0b mask general purpose interrupt on sdp1. gpi_sdp2 26 0b mask general purpose interrupt on sdp2. gpi_sdp3 27 0b mask general purpose interrupt on sdp3. pbur 28 0b mask rx/tx packet buffer unrecoverable error interrupt. dher 29 0b mask rx/tx descriptor handler error interrupt.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 321 software uses this register to disable an interrupt. interrupts are presented to the bus interface only when the mask bit is 1b and the cause bit is 1b. the status of the mask bit is reflected in the extended interrupt mask set/read register and the status of the cause bit is reflected in the interrupt cause read register (see section 4.4.3.3.1 ). software blocks interrupts by clearing the corresponding mask bit. this is accomplished by writing a 1b to the corresponding bit location (as defined in the eicr register). bits written with 0b are unchanged. this register provides software with a way to disable interrupts. software disables a given interrupt by writing a 1b to the corresponding bit. 4.4.3.3.5 extended interrupt auto clear register eiac (0x00810, rw) this register is mapped like previous interrupt registers; each bit is mapped to a corresponding bit in the eicr. eicr bits that have auto-clear set are cleared when the msi-x message that they trigger is sent on the pcie bus. note that an msi-x message might be delayed by itr moderation (from the time the eicr bit is activated). bits without auto-clear set need to be cleared using a write-to-clear. read-to-clear is not compatible with auto-clear; if any bits are set to auto-clear, read-to-clear should be disabled (use the configuration register bit). bits 29:20 should never be set to auto clear since they share the same msi-x vector. tcp timer 30 0b mask bit for corresponding eicr tcp timer interrupt condition. reserved 31 0b reserved field bit(s) initial value description rtxq 15:0 0x0 auto-clear bit for corresponding eicr rtxq interrupt condition. reserved 19:16 0x0 reserved lsc 20 0b auto-clear link status change interrupt. reserved 21 0b reserved mng 22 0b auto-clear manageability event interrupt reserved 23 0b reserved gpi_sdp0 24 0b auto-clear general purpose interrupt on sdp0. gpi_sdp1 25 0b auto-clear general purpose interrupt on sdp1. gpi_sdp2 26 0b auto-clear general purpose interrupt on sdp2. gpi_sdp3 27 0b auto-clear general purpose interrupt on sdp3. pbur 28 0b auto-clear rx/tx packet buffer unrecoverable error interrupt. dher 29 0b auto-clear rx/tx descriptor handler error interrupt. tcp timer 30 0b auto-clear bit for corresponding eicr tcp timer interrupt condition. reserved 31 0b reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 322 october 2010 4.4.3.3.6 extended interrupt auto mask enable register ? eiam (0x00890, rw) each bit in this register enables the setting of the corresponding bit in the eimc register following a write-to-clear to the eicr register or the setting of the corresponding bit in the eims register following a write-to-set to the eics register. 4.4.3.3.7 extended interrupt throttle registers ? eitr (0x00820 ? 0x0086c, rw) each itr is responsible for an interrupt cause. the allocation of itr to interrupt cause is through msi-x allocation registers. field bit(s) initial value description rtxq 15:0 0x0 auto-mask bit for corresponding eicr rtxq interrupt condition. reserved 19:16 0x0 reserved lsc 20 0b auto-mask link status change interrupt. reserved 21 0b reserved mng 22 0b auto-mask manageability event interrupt. reserved 23 0b reserved gpi_sdp0 24 0b auto-mask general purpose interrupt on sdp0. gpi_sdp1 25 0b auto-mask general purpose interrupt on sdp1. gpi_sdp2 26 0b auto-mask general purpose interrupt on sdp2. gpi_sdp3 27 0b auto-mask general purpose interrupt on sdp3. pbur 28 0b auto-mask rx/tx packet buffer unrecoverable error interrupt. dher 29 0b auto-mask rx/tx descriptor handler error interrupt. tcp timer 30 0b auto-mask bit for corresponding eicr tcp timer interrupt condition. reserved 31 0b reserved field bit(s) initial value description interval 15:0 0x0 minimum inter-interrupt interval the interval is specified in 256 ns increments. zero disables interrupt throttling logic. counter 31:16 start down counter loaded with interval value each time the associated interrupt is signaled. counts down to zero and stops. the associated interrupt is signaled each time this counter is zero and an associated (via the interrupt select register) eicr bit is set. this counter can be directly written by software at any time to alter the throttles performance.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 323 software uses this register to even out the delivery of interrupts to the host cpu. the register provides a guaranteed inter-interrupt delay between interrupts, regardless of network traffic conditions. to independently validate configuration settings, software should use the following algorithm to convert the inter-interrupt interval value to the common interrupts/seconds performance metric: interrupts/sec = (256 10 -9 sec x interval) -1 for example, if the interval is programmed to 500d, the 82598 guarantees the cpu is not interrupted by it for 128 ? s from the last interrupt. the maximum observed interrupt rate from the 82598 should never exceed 7813 interrupts/seconds. inversely, the inter-interrupt interval value can be calculated as: inter-interrupt interval = (256 10 -9 sec x interrupts/sec) -1 the optimal performance setting for this register is system and configuration specific. 4.4.3.3.8 interrupt vector allocation registers ivar (0x00900 + 4*n [n=0?24], rw) these registers have two modes of operation: 1. in msi-x mode, these registers define allocation of different interrupt causes to msi-x vectors. each int_alloc[i] (i=0?97) field is a byte indexing an entry in the msi-x table structure and msi-x pba structure. 2. in non msi-x mode, these registers define the allocation of the rx/tx queue interrupt causes to one of the rtxq bits in the eicr. each int_alloc[i] (i=0?97) field is a byte indexing the appropriate rtxq bit. 31 ?.24 23 16 15 8 7 0 int_alloc[3] int_alloc[2] int_alloc[1] int_alloc[0] ???? ???? reserved reserved int_alloc[97] int_alloc[96] field bit(s) initial value description int_alloc[0] 4:0 0x0 defines the msi-x vector assigned to the interrupt cause associated with this entry. reserved 6:5 0x0 reserved int_alloc _val[0] 7 0b valid bit for int_alloc[0] int_alloc[1] 12:8 0x0 defines the msi-x vector assigned to the interrupt cause associated with this entry, as defined in. reserved 14:13 0x0 reserved int_alloc _val[1] 15 0b valid bit for int_alloc[1] int_alloc[2] 20:16 0x0 defines the msi-x vector assigned to the interrupt cause associated with this entry, as defined in.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 324 october 2010 4.4.3.3.9 msi-x table - msixt (bar3: 0x00000 ? 0x0013c, rw) 4.4.3.3.10 msi-x pending bit array ? msixpba (bar3: 0x02000, ro) 4.4.3.3.11 msi-x pending bit array clear ? pbacl (0x11068, rw) reserved 22:21 0x0 reserved int_alloc _val[2] 23 0b valid bit for int_alloc[2] int_alloc[3] 28:24 0x0 defines the msi-x vector assigned to the interrupt cause associated with this entry, as defined in. reserved 30:29 0x0 reserved int_alloc _val[3] 31 0b valid bit for int_alloc[3] dword3 dword2 dword1 dword0 entry address vector control msg data msg upper addr msg addr entry 0 0x00000 vector control msg data msg upper addr msg addr entry 1 0x00010 vector control msg data msg upper addr msg addr entry 2 0x00020 ? ? ? ? ? vector control msg data msg upper addr msg addr entry (19) 0x00130 field bit(s) initial value description penbit 19:0 0x0 msi-x pending bits each bit is set to 1b when the appropriate interrupt request is set and cleared to 0b when the appropriate interrupt request is cleared. reserved 31:20 0x0 reserved field bit(s) initial value description penbitclr 19:0 0x0 msi-x pending bits clear writing 1b to any bit clears it?s content; writing 0b has no effect. reading this register returns the msipba.penbit value. reserved 31:20 0x0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 325 4.4.3.3.12 general purpose interrupt enable ? gpie (0x00898, rw) the 82598 allows for up to four externally controlled interrupts. the lower four software-definable pins, sdp[3:0], can be mapped for use as gpi interrupt bits. the mappings are enabled by the sdpx_gpien bits only when these signals are also configured as inputs using sdpx_iodir. when configured to function as external interrupt pins, a gpi interrupt is generated when the corresponding pin is sampled in an active-high state. the bit mappings are listed in the following table for clarity. field bit(s) initial value description sdp0_gpien 0 0b general purpose interrupt detection enable for sdp0 if software-controllable io pin sdp0 is configured as an input, this bit (when 1b) enables use for gpi interrupt detection. sdp1_gpien 1 0b general purpose interrupt detection enable for sdp1 if software-controllable io pin sdp1 is configured as an input, this bit (when 1b) enables use for gpi interrupt detection. sdp2_gpien 2 0b general purpose interrupt detection enable for sdp2 if software-controllable io pin sdp2 is configured as an input, this bit (when 1b) enables use for gpi interrupt detection. sdp3_gpien 3 0b general purpose interrupt detection enable for sdp3 if software-controllable io pin sdp3 is configured as an input, this bit (when 1b) enables use for gpi interrupt detection. msix_mode 4 0b msix mode 0b = non-msix, ivar map rx/tx causes to 16 eicr bits, but msix[0] is asserted for all. 1b = msix mode, ivar maps rx/tx causes to 16 eicr bits. ocd 5 0b other clear disable when set indicates that only bits 20-29 of the eicr are cleared on read. eimen 6 0b eics immediate interrupt enable when set, setting bit in the eics causes an immediate interrupt. if not set, the eics interrupt waits for eitr expiration reserved 29:5 0x0 reserved eiame 30 0b extended interrupt auto mask enable when set (usually in msi-x mode); upon initializing an msi-x message, bits set in eiam associated with this message is cleared. otherwise, eiam is used only after a read or write of the eicr/eics registers. pba_ support 31 0b pba support when set, setting one of the extended interrupts masks via eims causes the pba bit of the associated msi-x vector to be cleared. otherwise, the 82598 behaves in a way supporting legacy int-x interrupts. note: should be cleared when working in int-x or msi mode and set in msi-x mode.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 326 october 2010 table 4-5. gpi to sdp bit mappings 4.4.3.4 flow control registers description 4.4.3.4.1 priority flow control type opcode ? pfctop (0x03008; rw) this register contains the type field hardware that is matched against a recognized class-based flow control packet. 4.4.3.4.2 flow control transmit timer value n ? fcttvn (0x03200 + 4*n[n=0..3]; rw) where each 32-bit register (n=0? 3) refers to two timer values (register 0 refers to timer 0 and 1, register 1 refers to timer 2 and 3, etc.). the 16-bit value in the ttv field is inserted into a transmitted frame (either xoff frames or any pause frame value in any software transmitted packets). it counts in units of slot time (usually 64 bytes). note: the 82598 uses a fixed slot time value of 64 byte times. 4.4.3.4.3 flow control receive threshold low ? fcrtl (0x03220 + 8*n[n=0..7]; rw) where each 32-bit register (n=0? 7) refers to a different receive packet buffer. sdp pin to be used as gpi esdp field settings resulting eicr bit (gpi) directionality enable as gpi interrupt 3 sdp3_iodir sdp3_gpien 27 2 sdp2_iodir sdp2_gpien 26 1 sdp1_iodir sdp1_gpien 25 0 sdp0_iodir sdp0_gpien 24 field bit(s) initial value description fct 15:0 0x8808 class-based flow control type fcop 31:16 0x0101 class-based flow control opcode field bit(s) initial value description ttv(2n) 15:0 0x0 transmit timer value 2n timer value included in xoff frames as timer (2n). for legacy 802.3x flow control packets, ttv0 is the only timer that is used. ttv(2n+1) 31:16 0x0 transmit timer value 2n+1 timer value included in xoff frames as timer 2n+1.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 327 this register contains the receive threshold used to determine when to send an xon packet and counts in units of bytes. the lower four bits must be programmed to 0x0 (16-byte granularity). software must set xone to enable the transmission of xon frames. each time incoming packets cross the receive high threshold (become more full), and then crosses the receive low threshold, with xone enabled (1b), hardware transmits an xon frame. flow control reception/transmission is negotiated through by the auto negotiation process. when the 82598 is manually configured, flow control operation is determined by the rfce and rpfce bits. 4.4.3.4.4 flow control receive threshold high ? fcrth (0x03260 + 8*n[n=0..7]; rw) where each 32-bit register (n=0? 7) refers to a different receive packet buffer. this register contains the receive threshold used to determine when to send an xoff packet and counts in units of bytes. the value must be at least eight bytes less than the maximum number of bytes allocated to the receive packet buffer and the lower four bits must be programmed to 0x0 (16-byte granularity). each time the receive fifo reaches the fullness indicated by rth, hardware transmits a pause frame if the transmission of flow control frames is enabled. field bit(s) initial value description reserved 3:0 0x0 reserved the underlying bits might not be implemented in all versions of the 82598. must be written with 0x0. rtl[n] 18:4 0x0 receive threshold low n receive packet buffer n fifo low water mark for flow control transmission (256 bytes granularity). reserved 30:19 0x0 reserved reads as 0x0. should be written to 0x0 for future compatibility. xone[n] 31 0b xon enable n per the receive packet buffer xon enable. 0b = disabled 1b = enabled. field bit(s) initial value description reserved 3:0 0x0 reserved the underlying bits might not be implemented in all versions of the 82598. must be written with 0x0. rth[n] 18:4 0x0 receive threshold high n receive packet buffer n fifo high water mark for flow control transmission (16 bytes granularity). reserved 30:19 0x0 reserved reads as 0x0 should be written to 0x0 for future compatibility. fcen[n] 31 0b flow control enable for receive packet buffer n.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 328 october 2010 4.4.3.4.5 flow control refresh threshold value ? fcrtv (0x032a0; rw) 4.4.3.4.6 transmit flow control status ? tfcs (0x0ce00; ro) field bit(s) initial value description fc_refresh_ th 15:0 0x0 flow control refresh threshold this value indicates the threshold value of the flow control shadow counter. when the counter reaches this value, and the conditions for a pause state are still valid (buffer fullness above low threshold value), a pause (xoff) frame is sent to link partner. reserved 31:16 0x0 reserved field bit(s) initial value description txoff 0 0b transmission paused pause state indication of the transmit function when symmetrical flow control is enabled. reserved 7:1 0x0 reserved txoff0 8 0b packet buffer 0 transmission paused pause state indication of the pb0 when class-based flow control is enabled. txoff1 9 0b packet buffer 1 transmission paused pause state indication of the pb1 when class-based flow control is enabled. txoff2 10 0b packet buffer 2 transmission paused pause state indication of the pb2 when class-based flow control is enabled. txoff3 11 0b packet buffer 3 transmission paused pause state indication of the pb3 when class-based flow control is enabled. txoff4 12 0b packet buffer 4 transmission paused pause state indication of the pb4 when class-based flow control is enabled. txoff5 13 0b packet buffer 5 transmission paused pause state indication of the pb5 when class-based flow control is enabled. txoff6 14 0b packet buffer 6 transmission paused pause state indication of the pb6 when class-based flow control is enabled. txoff7 15 0b packet buffer 7 transmission paused pause state indication of the pb7 when class-based flow control is enabled. reserved 31:16 0x0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 329 4.4.3.5 receive dma registers 4.4.3.5.1 receive descriptor base address low ? rdbal (0x01000 + 0x40*n[n=0..63]; rw) this register contains the lower bits of the 64-bit descriptor base address. the lower seven bits are ignored. the receive descriptor base address must point to a 16-byte aligned block of data. 4.4.3.5.2 receive descriptor base address high ? rdbah (0x01004 + 0x40*n[n=0..63]; rw) this register contains the upper 32 bits of the 64-bit descriptor base address. 4.4.3.5.3 receive descriptor length ? rdlen (0x01008 + 0x40*n[n=0..63]; rw) this register sets the number of bytes allocated for descriptors in the circular descriptor buffer. it must be 128-byte aligned. 4.4.3.5.4 receive descriptor head ? rdh (0x01010 + 0x40*n[n=0..63]; ro) this register contains the head pointer for the receive descriptor buffer. the register points to a 16-byte datum. hardware controls the pointer. the only time that software should write to this register is after a reset (hardware reset or ctrl.rst) and before enabling the receive function (rxctrl.rxen). field bit(s) initial value description 0 6:0 0x0 ignored on writes. returns 0x0 on reads. rdbal 31:7 x receive descriptor base address low field bit(s) initial value description rdbah 31:0 x receive descriptor base address [63:32] field bit(s) initial value description 0 6:0 0x0 ignore on write. reads back as 0x0. len 19:7 0x0 descriptor length. reserved 31:20 0x0 reads as 0x0. should be written to 0 for future compatibility. field bit(s) initial value description rdh 15:0 0x0 receive descriptor head reserved 31:16 0x0 reserved. should be written with 0x0.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 330 october 2010 4.4.3.5.5 receive descriptor tail ? rdt (0x01018 + 0x40*n[n=0..63]; rw) this register contains the tail pointers for the receive descriptor buffer. the register points to a 16-byte datum. software writes the tail register to add receive descriptors to the hardware free list for the ring. note: if the 82598 uses the packet-split feature, software should write an even number to the tail register. the tail pointer should be set to point one descriptor beyond the last empty descriptor in host descriptor ring. 4.4.3.5.6 receive descriptor control ? rxdctl (0x01028 + 0x40*n[n=0..63]; rw) the register controls the fetching and write-back of receive descriptors. three threshold values are used to determine when descriptors are read from and written to host memory. pthresh is used to control when a pre-fetch of descriptors is considered. this threshold refers to the number of valid, unprocessed, receive descriptors in the on-chip descriptor buffer. if the number drops below pthresh, the algorithm considers pre-fetching descriptors from host memory. the host memory fetch does not happen, however, unless there are at least hthresh valid descriptors in host memory to fetch. wthresh controls the write-back of processed receive descriptors. this threshold refers to the number of receive descriptors in the on-chip buffer which are ready to be written back to host memory. in the absence of external events (explicit flushes), the write-back occurs only after at least wthresh descriptors are available for write-back. field bit(s) initial value description rdt 15:0 0x0 receive descriptor tail reserved 31:16 0x0 reads as 0x0. should be written to 0x0 for future compatibility. field bit(s) initial value description pthresh 6:0 0x00 pre-fetch threshold reserved 7 0x00 reserved hthresh 14:8 0x00 host threshold reserved 15 0x00 reserved wthresh 22:16 0x01 write-back threshold reserved 24:23 0x00 reserved enable 25 0b receive queue enable when set, the enable bit enables the operation of the specific receive queue, upon read ? get the actual status of the queue (internal indication that the queue is actually enabled/disabled). reserved 26 0b received reserved 31:27 0x00 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 331 possible values: pthresh = 0..32 wthresh = 0..16 hthresh = 0, 4, 8 note: for proper operation, the pthresh value should be larger than the number of buffers needed to accommodate a single packet/tso. note: since the default value for write-back threshold is one, descriptors are normally written back as soon as one descriptor is available. wthresh must contain a non-zero value to take advantage of write-back bursting capabilities.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 332 october 2010 4.4.3.5.7 split receive control registers ? srrctl (0x02100 ? 0x0213c; rw) 4.4.3.5.8 rx dca control register ? dca_rxctrl (0x02200 ? 0x0223c; rw) field bit(s) initial value description bsizepacket 6:0 0x2 receive buffer size for packet buffer the value is in 1 kb resolution. value can be from 1 kb to 16 kb. default buffer size is 2 kb. this field should not be set to 0x0. rxctrl.dmbyps should be set to 1b to bypass the descriptor monitor functionality. reserved 7 0b reserved. should be written with 0b to ensure future compatibility. bsizeheader1 13:8 0x4 receive buffer size for header buffer the value is in 64 bytes resolution. value can be from 64 bytes to 1024 bytes. default buffer size is 256 bytes. this field must be greater than zero if the value of desctype is greater or equal to two. values above 1024 bytes are reserved for internal use only. note: bsizeheader must be bigger than zero if desctype is equal to 010b, 011b 100b or 101b. reserved 24:14 0x0 reserved desctype 27:25 000b define the descriptor type in rx. 000b = legacy 001b = advanced descriptor one buffer 010b = advanced descriptor header splitting 011b = reserved 100b = reserved 101b = advanced descriptor header splitting always use header buffer. 110b ? 111b = reserved. reserved 31:28 0x0 reserved should be written with 0x0 to ensure future compatibility. field bit(s) initial value description cpuid 4:0 0x0 physical id in front side bus (fs)b platforms, the software device driver, after discovering the physical cpu id and cpu bus id, programs it into these bits for hardware to associate physical cpu and bus id with the adequate rss queue. bits 2:1 are target agent id, bit 3 is the bus id. bits 2:0 are copied into bits 3:1 in the tag field of the tlp headers of pcie messages. in csi platforms, the software device driver programs a value, based on the relevant apic id, corresponding to the adequate rss queue. this value is copied in the 4:0 bits of the dca preferences field in tlp headers of pcie messages. rx descriptor dca en 50b descriptor dca en when set, hardware enables dca for all rx descriptors written back into memory. when cleared, hardware does not enable dca for descriptor write- backs.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 333 the rx data write no-snoop is activated when the nse bit is set in the receive descriptor. 4.4.3.5.9 receive dma control register ? rdrxctl (0x02f00; rw) rx header dca en 6 0b rx header dca en when set, hardware enables dca for all received header buffers. when cleared, hardware does not enable dca for rx header. reserved 7 0b reserved rxdescreadnsen 8 0b rx descriptor read no-snoop enable this bit must be reset to 0b to ensure correct functionality (except if the software device driver can guarantee the data is present in the main memory before the dma process occurs (the software device driver has written the data with a write-through instruction). rxdescreadroen 9 1b rx descriptor read relax order enable rxdescwbnsen 10 0b rx descriptor write back no-snoop enable note: this bit must be reset to 0b to ensure correct functionality of the descriptor write-back. rxdescwbroen 11 0b (ro) rx descriptor write back relax order enable this bit must be 0b to allow correct functionality of the descriptors write-back. rxdatawritensen 12 1b rx data write no snoop enable when 0b, the last bit of the packet buffer address field in advanced receive descriptor is used as least significant bit of the packet buffer address (a0), thus enabling 8-bit alignment of the buffer. when 1b, the last bit of the packet buffer address field in advanced receive descriptor is used as no-snoop enabling (nse) bit. in this case, the buffer is 16- bit aligned. in this case, (bit set to 1b), the nse bit determines whether the data buffer is snooped or not. rxdatawriteroen 13 1b rx data write relax order enable rxrepheadernsen 14 0b rx split header no-snoop enable this bit must be reset to 0b to enable correct functionality of a header write to host memory. rxrepheaderroen 15 1b rx split header relax order enable reserved 31:16 0x0 reserved field bit(s) initial value description rdmts 1:0 00b receive descriptor minimum threshold size the corresponding interrupt is set each time the fractional number of free descriptors becomes equal to rdmts. 00b = 1/2. 01b = 1/4. 10b = 1/8. 11b = reserved. reserved 2 0b reserved dmaidone 3 0b dma init done when read as 1b, indicates that the dma init cycle is done (ro).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 334 october 2010 4.4.3.5.10 receive packet buffer size ? rxpbsize (0x03c00 ? 0x03c1c; rw) 4.4.3.5.11 receive control register ? rxctrl (0x03000; rw) reserved 4 0b reserved mvmen 5 0b dma configuration for mac/vlan (vmdq) mode registers mapping this mode is enabled when set to 1b. mcen 6 0b dma configuration for multiple cores (rss) registers mapping this mode is enabled when set to 1b. reserved 7 00x reserved rxdpipesize 12:8 0x0 receive data pipe size limits the amount of pending bytes in the dma rx queue (resolution in 1 kb). reserved 31:13 0x0 reserved field bit(s) initial value description reserved 9:0 0x0 reserved size 19:10 0x200/0 receive packet buffer size default values: 0x200 (512 kb) for rxpbsize0. 0x0 (0 kb) for rxpbsize1-7. other than the default configuration of one packet buffer, the 82598 supports two more configurations: partitioned receive equal: 0x40 (64 kb) for rxpbsize0-7. partitioned receive not equal: 0x50 (80 kb) for rxpbsize0-3. 0x30 (48 kb) for rxpbsize4-7. reserved 31:20 0x0 reserved field bit(s) initial value description rxen 0 0b receive enable when set to 0b, filter inputs to the packet buffer are ignored. dmbyps 1 1b descriptor monitor bypass when set to 1b, the descriptor monitor (checking if there are enough descriptors in the target queue) is disabled. reserved 31:2 0x0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 335 4.4.3.5.12 drop enable control ? dropen (0x03d04 ? 0x03d08; rw) 4.4.3.6 receive registers 4.4.3.6.1 receive checksum control ? rxcsum (0x05000; rw) the receive checksum control register controls receive checksum offloading features. the 82598 supports offloading of three receive checksum calculations: the fragment checksum, the ip header checksum, and the tcp/udp checksum. pcsd the fragment checksum and ip identification fields are mutually exclusive with the rss hash. only one of the two options is reported in the rx descriptor. the rxcsum.pcsd affect is listed in the following table: ippcse this is the ippcse control the fragment checksum calculation. as previously noted, the fragment checksum shares the same location as the rss field. the fragment checksum is reported in the receive descriptor when the rxcsum.pcsd bit is cleared. if rxcsum.ippcse cleared (the default value), the checksum calculation is not done and the value that is reported in the rx fragment checksum field is 0b. field bit(s) initial value description drop_en 31:0 0x0 drop enabled if set to 1b, packets received to the queue when no descriptors are available to store them are dropped. if set to 0b, packets received to the queue when no descriptors are available to store are held in an internal buffer until descriptors are available again. each bit represents the appropriate queue (bit 0 in dropen0 represents queue0; bit 31 in dropen1 represents queue 63). when rxctrl.dmbyps is set to 1b, only packets received to a disabled queue are dropped.? field bit(s) initial value description reserved 11:0 0x0 reserved ippcse 12 0b ip payload checksum enable pcsd 13 0b rss/fragment checksum status selection when set to 1b, the extended descriptor write-back has the rss field. when set to 0b, it contains the fragment checksum. reserved 31:14 0x0 reserved rxcsum.pcsd 0 (checksum enable) 1 (checksum disable) fragment checksum and ip identification are reported in the rx descriptor rss hash value is reported in the rx descriptor
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 336 october 2010 if the rxcsum.ippcse is set, the fragment checksum is aimed to accelerate checksum calculation of fragmented udp packets. this register should only be initialized (written) when the receiver is not enabled (only write this register when rxctrl.rxen = 0b). 4.4.3.6.2 receive filter control register ? rfctl (0x05008; rw) 4.4.3.6.3 multicast table array ? mta (0x05200-0x053fc; rw) \ field bit(s) initial value description reserved 5:0 0x0 reserved reserved 6 0b reserved. must be set to 0b. reserved 7 0b reserved. must be set to 0b. nfs_ver 9:8 0x0 nfs version 00b = nfs version 2. 01b = nfs version 3. 10b = nfs version 4. 11b = reserved for future use. reserved 10 0b reserved. must be set to 0b. reserved 11 0b reserved. must be set to 0b. reserved 13:12 00b reserved reserved 14 0b reserved. must be set to 0b. reserved 15 00b reserved reserved 16 0b reserved. must be set to 0b. field bit(s) initial value description reserved 17 0b reserved. must be set to 0b. reserved 31:18 0x0 reserved. should be written with 0x0 to ensure future compatibility. field bit(s) initial value description bit vector 31:0 x word wide bit vector specifying 32 bits in the multicast address filter table.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 337 the 82598 provides multicast filtering for 4096 multicast addresses by providing a single bit entry per multicast address. the 4096 address locations are organized in a multicast table array ? 128 registers of 32 bits. only 12 bits out of the 48-bit destination address are considered as multicast addresses. the 12 bits can be selected by the mo field of the mcstctrl register. figure 4-1 shows the multicast lookup algorithm. the destination address shown represents the internally stored ordering of the received da. note that bit 0 is the first bit on the wire. figure 4-1. multicast lookup algorithm 4.4.3.6.4 receive address low ? ral (0x05400 + 8*n[n=0..15]; rw) while "n" is the exact unicast/multicast address entry and it is equals to 0,1,?15. these registers contain the lower bits of the 48-bit ethernet address. all 32 bits are valid. if the eeprom is present, the first register (ral0) is loaded from the eeprom. the ral value should be configured to the register in host order. 4.4.3.6.5 receive address high ? rah (0x05404 + 8*n[n=0..15]; rw) while "n" is the exact unicast/multicast address entry and it is equals to 0,1,?15. field bit(s) initial value description ral 31:0 x receive address low the lower 32 bits of the 48-bit ethernet address.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 338 october 2010 the above registers contain the upper bits of a 48-bit ethernet address. the complete address is (rah, ral; for all 16 register pairs). av determines whether this address is compared against the incoming packet. av is cleared by a master reset. note: the first receive address register (rar0) is also used for exact match pause frame checking (da matches the first register). rar0 should always be used to store the ethernet mac address of the 82598. after reset, if an eeprom is present, the first register (receive address register 0) is loaded from the ia field in the eeprom, its address select field is 00b, and its address valid field is 1b. if no eeprom is present, the address valid field is 0b. the address valid field for all of the other registers are 0b. the rah value should be configured to the register in host order. 4.4.3.6.6 packet split receive type register ? psrtype (0x05480 ? 0x054bc, rw) field bit(s) initial value description rah 15:0 x receive address high the upper 16 bits of the 48-bit ethernet address. reserved 17:16 00b reserved vind 21:18 0x0 vmdq output index defines the vmdq output index associated with a received packet that matches this mac address (rah and ral). reserved 30:22 0x0 reserved. reads as 0. ignored on write. av 31 see description address valid cleared after master reset. if the eeprom is present, the address valid field of receive address register 0 is set to 1b after a software or pci reset or eeprom read. in entries 0-15 this bit is cleared by master reset. field bit(s) initial value description psr_type0 0 0b reserved psr_type1 1 1b header includes mac, (vlan/snap) ipv4, only. psr_type2 2 1b header includes mac, (vlan/snap) ipv4, tcp, only. psr_type3 3 1b header includes mac, (vlan/snap) ipv4, udp, only. psr_type4 4 1b header includes mac (vlan/snap), ipv4, ipv6, only. psr_type5 5 1b header includes mac (vlan/snap), ipv4, ipv6, tcp, only. psr_type6 6 1b header includes mac (vlan/snap), ipv4, ipv6, udp, only. psr_type7 7 1b header includes mac (vlan/snap), ipv6, only. psr_type8 8 1b header includes mac (vlan/snap), ipv6, tcp, only. psr_type9 9 1b header includes mac (vlan/snap), ipv6, udp, only.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 339 this bit mask table enables or disables each type of header to be split. 4.4.3.6.7 vlan filter table array ? vfta (0x0a000-0x0a9fc; rw) the vlan filter table array structure is shown in figure 4-2 . each of five sections has 128 lines, each a dword wide. the first section contains 128 lines of 32-bits that create a 4096-bit long vlan filter. each bit corresponds to one value of the 12-bit vlan tag. the next four sections contain the vmdq output index for vlan tag values contained in the first section, (the first section contains vmdq outputs for each of the first bytes in the first section, the second section contains vmdq outputs for each of the second bytes in the first section and so forth). the first byte in the first section has its vmdq values in the second section first dword. for example, bit 0 in section 1 of line 0 corresponds to a vlan tag of 0x000. bits 3:0 in section 2 of line 0 contain the vmdq output index for vlan tag of 0x000. bit 1 in section 1 of line 0 corresponds to a vlan tag of 0x001. bits 7:4 in section 2 of line 0 contain the vmdq output index for vlan tag of 0x001, etc. note: all accesses to this table must be 32-bit. psr_type10 10 0b reserved psr_type11 11 1b header includes mac, (vlan/snap), ipv4, tcp, nfs, only. psr_type12 12 1b header includes mac, (vlan/snap), ipv4, udp, nfs, only. psr_type13 13 0b reserved psr_type14 14 1b header includes mac (vlan/snap), ipv4, ipv6, tcp, nfs, only. psr_type15 15 1b header includes mac (vlan/snap), ipv4, ipv6, udp, nfs, only. psr_type16 16 0b reserved psr_type17 17 1b header includes mac (vlan/snap), ipv6, tcp, nfs, only. psr_type18 18 1b header includes mac (vlan/snap), ipv6, udp, nfs, only. reserved 31:19 x reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 340 october 2010 figure 4-2. vlan filter table array ? vfta the general structure of the vfta memory is as follows. table 4-6. structure of vfta memory dw in line n bit(s) description dw0 31:0 filter value for vlan tag value equal to [31:0] each bit when set, enables packets with this vlan tag value to pass. when cleared, blocks packets with this vlan tag. ? dw127 31 filter value for vlan tag value equal to [4095:4064] each bit when set, enables packets with this vlan tag value to pass. when cleared, blocks packets with this vlan tag. dw128 3:0 vmdq output index for vlan tag value 0x000. dw128 7:4 vmdq output index for vlan tag value 0x001. ? dw128 31:28 vmdq output index for vlan tag value 0x007. ? dw in line n bit(s) description dw255 31:28 vmdq output index for vlan tag value 0xfe7. dw256 3:0 vmdq output index for vlan tag value 0x008. dw256 7:4 vmdq output index for vlan tag value 0x009.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 341 4.4.3.6.8 filter control register ? fctrl (0x05080, rw) ? dw256 31:28 vmdq output index for vlan tag value 0x00f . ? dw383 31:28 vmdq output index for vlan tag value 0xfef. dw384 3:0 vmdq output index for vlan tag value 0x010. dw384 7:4 vmdq output index for vlan tag value 0x011. ? dw384 31:28 vmdq output index for vlan tag value 0x017. ? dw511 31:28 vmdq output index for vlan tag value 0xff7. dw512 3:0 vmdq output index for vlan tag value 0x018. dw512 7:4 vmdq output index for vlan tag value 0x019. ? dw512 31:28 vmdq output index for vlan tag value 0x01f. ? dw640 31:28 vmdq output index for vlan tag value 0xfff. field bit(s) initial value description reserved 31:16 0x0 reserved rfce 15 0b receive flow control enable indicates that the 82598 responds to the reception of link flow control packets. if auto negotiation is enabled, this bit should be set by software to the negotiated flow control value. note: when set, the 82598 does not count received flow control frames. note: this bit should not be set if bit 14 is set. rpfce 14 0b receive priority flow control enable indicates that the 82598 responds to the reception of priority flow control packets. if auto negotiation is enabled this bit should be set by software to the negotiated flow control value. note: receive priority flow control and receive link flow control are mutually exclusive and should not be configured at the same time. note: this bit should not be set if bit 15 is set. dpf 13 0b discard pause frame when set to 1b, unicast pause frames are sent to the host. setting this bit to 1b causes unicast pause frames to be discarded only when rfce or rpfce are set to 1b. if both rfce and rpfce are set to 0b, this bit has no effect on incoming pause frames. table 4-6. structure of vfta memory
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 342 october 2010 note: before receive filters are being updated/modified the rxctrl.rxen bit should be set to 0b. after the proper filters have been set the rxctrl.rxen bit can be set to 1b to re-enable the receiver. pmcf 12 0b pass mac control frames filter out unrecognized pause (flow control opcode does not match) and other control frames. 0b = filter unrecognized pause frames. 1b = pass/forward unrecognized pause frames. reserved 11 0b reserved bam 10 0b broadcast accept mode 0b ? ignore broadcast packets to host. 1b ? accept broadcast packets to host. upe 9 0b unicast promiscuous enable 0b = disabled. 1b = enabled. mpe 8 0b multicast promiscuous enable 0b = disabled. 1b = enabled. reserved 7:2 0x0 reserved field bit(s) initial value description sbp 1 0b store bad packets 0b = do not store. 1b = store. note that crc errors before the sfd are ignored. any packet must have a valid sfd (rx_dv with no rx_er in the xgmii/gmii interface) in order to be recognized by the 82598 (even bad packets). note: packets with errors are not routed to manageability even if this bit is set. when this bit is set to 1b, it is not guaranteed that the status in the descriptor write-back is valid for packets shorter than 64 bytes. the queue assignment is not guaranteed. the relevant error bits are still valid. note: packets with a valid error (caused by a byte error or illegal error) might have data corruption in the last eight bytes when stored in host memory if the sbp bit is set. reserved 0 0b reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 343 4.4.3.6.9 vlan control register ? vlnctrl (0x05088, rw) 4.4.3.6.10 multicast control register ? mcstctrl (0x05090, rw) 4.4.3.6.11 multiple receive queues command register mrqc (0x05818; rw) field bit(s) initial value description vme 31 0b vlan mode enable when set to 1b, on receive, vlan information is stripped from 802.1q packets. vfe 30 0b vlan filter enable 0b = disabled (filter table does not decide packet acceptance). 1b = enabled (filter table decides packet acceptance for 802.1q packets). cfien 29 0b canonical form indicator enable 0b = disabled (cfi bit not compared to decide packet acceptance). 1b = enabled (cfi from packet must match next cfi field to accept 802.1q packets). cfi 28 0b canonical form indicator bit value if cfien is set to 1b, then 802.1q packets with cfi equal to this field are accepted; otherwise, the 802.1q packet is discarded. reserved 27:16 0x0 reserved vet 15:0 0x8100 vlan ether type this register contains the type field that the hardware matches against to recognize an 802.1q (vlan) ethernet packet. to be compliant with the 802.3ac standard, this register should be programmed with the value 0x8100. for vlan transmission the upper byte is first on the wire (vlnctrl.vet[15:8]). field bit(s) initial value description reserved 31:3 0x0 reserved mfe 2 0b multicast filter enable 0b = disabled (filter is not applied ? all multicast packets are not accepted). 1b = enabled. mo 1:0 00b multicast offset this determines which bits of the incoming multicast address are used in looking up the bit vector. 00b = [47:36]. 01b = [46:35]. 10b = [45:34]. 11b = [43:32]. field bit(s) initial value description rss enable 0 0b rss enable when set, enables receive side scaling (rss) operation. 0b = rss disabled. 1b = rss enabled.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 344 october 2010 note: disabling rss on the fly is not allowed. model usage is to reset the 82598 after disabling rss. 4.4.3.6.12 vmdq control register ? vmd_ctl (0x0581c; rw) 4.4.3.6.13 immediate interrupt rx imir (0x05a80 + 4*n[n=0..7], rw) this register defines the filtering that determines which packet triggers a dynamic interrupt moderation. reserved 15:1 0x0 reserved rss field enable 31:16 0x0 each bit, when set, enables a specific field selection to be used by the hash function. several bits can be set at the same time. bit[16] = enable tcpipv4 hash function. bit[17] = enable ipv4 hash function. bit[18] = enable tcpipv6ex hash function. bit[19] = reserved. bit[20] = enable ipv6 hash function. bit[21] = enable tcpipv6 hash function. bit[22] = enable udpipv4. bit[23] = enable udpipv6. bit[24] = enable udpipv6ext. bits[31:25] = reserved (0x0). field bit(s) initial value description vmdq enable 0 0b vmdq enable when set, enables vmdq operation. 0b = vmdq disabled. 1b = vmdq enabled. vmdq filter 1 0b vmdq filter determines the filtering mode used for vmdq filtering: 0b = mac filtering. 1b = reserved. this bit has no impact when vmdq is disabled. reserved 3:2 00b reserved default vmdq output index 7:4 0x0 default vmdq output index determines the vmdq output index for received packets that cannot be classified by the vmdq procedures (such as broadcast packets). reserved 31:8 0x0 reserved field bit(s) initial value description port 15:0 0x0 destination tcp port this field is compared with the destination tcp port in incoming packets. the port value should be configured to the register in host order.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 345 another register includes a size threshold and a control bits bitmap to trigger an immediate interrupt. 4.4.3.6.14 immediate interrupt rx extended imirext (0x05aa0 + 4*n[n=0..7], rw) 4.4.3.6.15 immediate interrupt rx vlan priority register imirvp (0x05ac0, rw) port_im_en 16 0b destination tcp port enable allows issuing an immediate interrupt if all the following three conditions are met: ? packet tcp destination port is equal to port field ? packet length of incoming packet is smaller than size_thresh in im_imirext register ? at least one of the tcp control bits of incoming packets is set and the corresponding bit in the ctrlbit field in the imirext register is set. port_bp 17 0b port bypass when 1b, the tcp port check is bypassed and only other conditions are checked. when 0b, the tcp port is checked to fit to port field. reserved 31:18 0 reserved field bit(s) initial value description size_thresh 11:0 0x0 size threshold these 12 bits define a size threshold; a packet with length below this threshold triggers an interrupt. enabled by size_thresh_en. size_bp 12 0b size bypass when 1b, the size check is bypassed. when 0b, the size check is performed. ctrlbit 18:13 0x0 control bit when a bit in this field is equal to 1b, an interrupt is immediately issued after receiving a packet with corresponding tcp control bits turned on. bit: 13: urg = urgent pointer field significant. 14: ack = acknowledgment field. 15: psh = push function. 16: rst = reset the connection. 17: syn = synchronize sequence numbers. 18: fin = no more data from sender. ctrlbit_bp 19 0b control bits bypass when 1b, the control bits check is bypassed. when 0b, the control bits check is performed. reserved 31:20 0x0 reserved field bit(s) initial value description vlan_pri 2:0 000b vlan priority this field includes the vlan priority threshold. when vlan_pri_en is set to 1b, then an incoming packet with vlan tag with a priority equal or higher to vlanpri triggers an immediate interrupt, regardless of the itr moderation.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 346 october 2010 4.4.3.6.16 indirection table ? reta (0x05c00-0x0057c; rw) the indirection table is a 128-entry table, each entry is 8 bits wide. each entry stores a 4-bit rss output index or a pair of 4-bit indices. the table is configured through the following read/write registers. ... ... each entry (byte) of the indirection table contains the following information: ? bits [7:4] ? rss output index 1 (optional) ? bits [3:0] ? rss output index 0 the contents of the indirection table is not defined following reset of the memory configuration registers. system software must initialize the table prior to enabling multiple receive queues. it might also update the indirection table during run time. such updates of the table are not synchronized with the arrival time of received packets. therefore, it is not guaranteed that a table update takes effect on a specific packet boundary. vlan_pri_en 3 0b vlan priority enable when 1b, an incoming packet with vlan tag with a priority equal or higher to vlan_pri triggers an immediate interrupt, regardless of the itr moderation. when 0b, the interrupt is moderated by itr. reserved 31:4 0x0 reserved 31 ?.24 23 16 15 8 7 0 entry 3 entry 2 entry 1 entry 0 ?? entry 127 ? ? ? field dword/ bit(s) initial value description entry0 7:0 0x0 determines rss output index or indices for hash value of 0x00. entry1 15:8 0x0 determines rss output index or indices for hash value of 0x01. entry2 23:16 0x0 determines rss output index or indices for hash value of 0x02. entry3 31:24 0x0 determines rss output index or indices for hash value of 0x03. 7:4 3:0 rss index 1 rss index 0
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 347 if the operating system provides an indirection table whose size is smaller than 128 bytes, software should replicate the operating system-provided indirection table to span the entire 128 bytes of the hardware indirection table. 4.4.3.6.17 rss random key register ? rssrk (0x05c80-0x05ca4; rw) the rss random key register stores a 40-byte key used by the rss hash function. ... ... ... 4.4.3.7 transmit register descriptions 4.4.3.7.1 transmit descriptor base address low ? tdbal (0x06000 + n*0x40[n=0..31]; rw) this register contains the lower bits of the 64-bit descriptor base address. the lower seven bits are ignored. the transmit descriptor base address must point to a 16-byte aligned block of data. 31 ?.24 23 16 15 8 7 0 k[3] k[2] k[1] k[0] ?? k[39] ? ? k[36] field dword/ bit(s) initial value description k0 7:0 0x0 byte 0 of the rss random key. k1 15:8 0x0 byte 1 of the rss random key. k2 23:16 0x0 byte 2 of the rss random key. k3 31:24 0x0 byte 3 of the rss random key. field bit(s) initial value description 0 6:0 0x0 ignored on writes. returns 0x0 on reads. tdbal 31:7 x transmit descriptor base address low
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 348 october 2010 4.4.3.7.2 transmit descriptor base address high ? tdbah (0x06004 + n*0x40[n=0..31]; rw) this register contains the upper 32 bits of the 64-bit descriptor base address. 4.4.3.7.3 transmit descriptor length ? tdlen (0x06008 + n*0x40[n=0..31]; rw) this register contains the descriptor length and must be 128-byte aligned. 4.4.3.7.4 transmit descriptor head ? tdh (0x06010 + n*0x40[n=0..31]; ro) this register contains the head pointer for the transmit descriptor ring. it points to a 16-byte datum. hardware controls the pointer. the only time that software should write to this register is after a reset (hardware reset or ctrl.rst) and before enabling the transmit function (txdctl.enable). if software writes to this register while the transmit function is enabled, on-chip descriptor buffers might be invalidated and hardware behavior might be indeterminate. 4.4.3.7.5 transmit descriptor tail ? tdt (0x06018 + n*0x40[n=0..31]; rw) this register contains the tail pointer for the transmit descriptor ring. it points to a 16-byte datum. software writes the tail pointer to add more descriptors to the transmit ready queue. hardware attempts to transmit all packets referenced by descriptors between head and tail. field bit(s) initial value description tdbah 31:0 x transmit descriptor base address [63:32] field bit(s) initial value description 0 6:0 0x0 ignore on write. reads back as 0x0. len 19:7 0x0 descriptor length reserved 31:20 0x0 reads as 0x0. should be written to 0x0. field bit(s) initial value description tdh 15:0 0x0 transmit descriptor head reserved 31:16 0x0 reserved. should be written with 0x0. field bit(s) initial value description tdt 15:0 0x0 transmit descriptor tail reserved 31:16 0x0 reads as 0x0. should be written to 0x0 for future compatibility.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 349 4.4.3.7.6 transmit descriptor control ? txdctl (0x06028 + n*0x40[n=0..31]; rw) this register controls the fetching and write-back of transmit descriptors. three threshold values are used to determine when descriptors are read from and written to host memory. pthresh is used to control when a pre-fetch of descriptors is considered. this threshold refers to the number of valid, unprocessed transmit descriptors the chip has in its on-chip buffer. if the number drops below pthresh, the algorithm considers pre-fetching descriptors from host memory. this fetch does not happen, however, unless there are at least hthresh valid descriptors in host memory to fetch. wthresh controls the write-back of processed transmit descriptors. this threshold refers to the number of transmit descriptors in the on-chip buffer that are ready to be written back to host memory. in the absence of external events (explicit flushes), the write-back occurs only after at least wthresh descriptors are available for write-back. note: when wthresh = 0b, only descriptors with the rs bit set is written back. since write-back of transmit descriptors is optional (under the control of rs bit in the descriptor), not all processed descriptors are counted with respect to wthresh. descriptors start accumulating after a descriptor with the rs bit set. furthermore, with transmit descriptor bursting enabled, some descriptors are written back that did not have the rs bit set in their respective descriptors. for proper operation, the pthresh value should be larger than the number of buffers needed to accommodate a single packet/tso. possible values: ? pthresh = 0..32 ? wthresh = 0..16 ? hthresh = 0, 4, 8 field bit(s) initial value description pthresh 6:0 0x00 pre-fetch threshold reserved 7 0x00 reserved hthresh 14:8 0x00 host threshold reserved 15 0x00 reserved wthresh 22:16 0x00 write-back threshold reserved 24:23 0x00 reserved enable 25 0b transmit queue enable when set, the enable bit enables the operation of the specific transmit queue, upon read ? get the actual status of the queue (internal indication that the queue is actually enabled/disable). reserved 31:26 0b reserved reserved 31:27 0x00 reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 350 october 2010 4.4.3.7.7 tx descriptor completion write back address low ? tdwbal (0x06038 + n*0x40[n=0..31]; rw) 4.4.3.7.8 tx descriptor completion write back address high ? tdwbah (0x0603c + n*0x40[n=0..31]; rw) 4.4.3.7.9 dma tx control ? dtxctl (0x07e00; rw) this register controls whether or not the ip identification field scrolls on 15-bit or 16- bit boundaries in tso packets. field bit(s) initial value description head_wb_en 0 0b head write-back enable when 1b, head write-back is enabled. when 0b, head write-back is disabled. reserved 1 0b reserved reserved 3:2 00b reserved headwb_low 31:4 0x00 lowest 32 bits of head write-back memory location (dword-aligned). last four bits are always 0000b. field bit(s) initial value description headwb_high 31:0 0x0000 0000 highest 32 bits of head write-back memory location (for 64-bit addressing) field bit(s) initial value description reserved 0 0b reserved reserved 1 0b reserved endbubd 2 0b enable dbu buffer division, enable writing to dbu non-zero buffer. reserved 31:3 0x0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 351 4.4.3.7.10 tx dca control register ? dca_txctrl (0x07200 ? 0x0723c; rw) 4.4.3.7.11 transmit ipg control ? tipg (0x0cb00; rw) this register controls the inter packet gap (ipg) timer. ipgt specifies the extension to the ipg length for back-to-back transmissions. field bit(s) initial value description cpuid 4:0 0x0 physical id in fsb platforms, the software device driver, upon discovery of the physical cpu id and cpu bus id, programs it into these bits for hardware to associate physical cpu and bus id with the adequate tx queue. bits 2:1 are target agent id, bit 3 is the bus id. bits 2:0 are copied into bits 3:1 in the tag field of the tlp headers of pcie messages. in csi platforms, the software device driver programs a value, based on the relevant apic id, corresponding to the adequate tx queue. this value is going to be copied in the 4:0 bits of the dca preferences field in tlp headers of pcie messages. tx descriptor dca en 50b descriptor dca en when set, hardware enables dca for all tx descriptors written back into memory. when cleared, hardware does not enable dca for descriptor write backs. default cleared. applies also to head write-back when enabled. reserved 7:6 00b reserved txdescrdnsen 8 0b tx descriptor read no-snoop enable note: this bit must be reset to 0b to ensure correct functionality (except if the software device driver has written this bit with write-through instruction). txdescrdroen 9 1b tx descriptor read relax order enable txdescwbnsen 10 0b tx descriptor write back no-snoop enable note: this bit must be reset to 0b to ensure correct functionality of descriptor write-back. applies also to head write-back when enabled. txdescwbroen 11 1b tx descriptor write back relaxed order enable applies also to head write-back when enabled. txdatareadnsen 12 0b tx data read no-snoop enable txdatareadroen 13 1b tx data read relax order enable reserved 31:14 0x0 reserved field bit(s) initial value description ipgt 7:0 0x0 ipg transmit time measured in increments of 4-byte times. note: for values greater than zero, the 82598 might violate the flow control timing specification (from xoff packet received to stopping the transmit side). reserved 31:8 0x0 reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 352 october 2010 4.4.3.7.12 transmit packet buffer size ? txpbsize (0x0cc00 ? 0x0cc1c; rw) 4.4.3.7.13 manageability transmit tc mapping ? mngtxmap (0x0cd10; rw) 4.4.3.8 wake-up control registers 4.4.3.8.1 wake up control register ? wuc (0x05800; rw) field bit(s) initial value description reserved 9:0 0x0 reserved size 19:10 0x28/0 transmit packet buffer size default values: 0x28 (40 kb) for txpbsize0. 0x0 (0 kb) for rxpbsize1-7. other than the default configuration of one packet buffer, the 82598 supports a partitioned configuration. partitioned transmit equal: 0x28 (40 kb) for txpbsize0-7. reserved 31:20 0x0 reserved field bit(s) initial value description map 2:0 0x0 map value indicates the tc that the transmit manageability traffic is routed to. reserved 31:3 0x0 reserved field bit(s) initial value description reserved 0 0b reserved pme_en 1 0b pme_en this read/write bit is used by the software device driver to access the pme_en bit of the power management control/status register (pmcsr) without writing to pcie configuration space. pme_status (ro) 2 0b pme_status this bit is set when the 82598 receives a wake-up event. it is the same as the pme_status bit in the power management control/status register (pmcsr). writing a 1b to this bit clears it. the pme_status bit in the pmcsr is also cleared. reserved 3 0b reserved advd3wuc 4 1b 1 d3cold wakeup capability advertisement enable when set, d3cold wakeup capability is advertised based on whether the aux_pwr advertises the presence of auxiliary power (yes if aux_pwr is indicated, no otherwise). when 0b; however, d3cold wakeup capability is not advertised even if aux_pwr presence is indicated. the data value and initial value is eeprom-configurable. reserved 31:5 0b reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 353 the pme_en and pme_status bits are reset when internal power on reset or lan_pwr_good is 0b. when aux_pwr = 0b or advd3wuc=0, these bits are also reset by asserting pe_rst_n. 4.4.3.8.2 wake up filter control register ? wufc (0x05808; rw) this register is used to enable each of the pre-defined and flexible filters for wake up support. a value of one means the filter is turned on, and a value of zero means the filter is turned off. if the notco bit is set, then any packet that passes the manageability packet filtering does not cause a wake-up event even if it passes one of the wake-up filters. 4.4.3.8.3 wake up status register ? wus (0x05810; ro) 1. loaded from the eeprom. field bit(s) initial value description lnkc 0 0b link status change wake up enable mag 1 0b magic packet wake up enable ex 2 0b directed exact wake up enable mc 3 0b directed multicast wake up enable bc 4 0b broadcast wake up enable arp 5 0b arp/ipv4 request packet wake up enable ipv4 6 0b directed ipv4 packet wake up enable ipv6 7 0b directed ipv6 packet wake up enable reserved 14:8 0x0 reserved notco 15 0b ignore tco packets for tco flx0 16 0b flexible filter 0 enable field bit(s) initial value description flx1 17 0b flexible filter 1 enable flx2 18 0b flexible filter 2 enable flx3 19 0b flexible filter 3 enable reserved 31:20 0x0 reserved field bit(s) initial value description lnkc 0 0b link status changed mag 1 0b magic packet received
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 354 october 2010 this register is used to record statistics about wake-up packets received. if a packet matches multiple criteria, multiple bits could be set. writing a 1b to any bit clears that bit. this register is not cleared when pe_rst_n is asserted. it is only cleared at internal power on reset or lan_pwr_good, or when cleared by the software device driver. 4.4.3.8.4 ip address valid ? ipav (0x5838; rw) the ip address valid indicates whether the ip addresses in the ip address table are valid. ex 2 0b directed exact packet received the packet?s address matched one of the 16 pre-programmed exact values in the receive address registers. mc 3 0b directed multicast packet received the packet was a multicast packet whose hashed to a value that corresponded to a 1 bit in the multicast table array. bc 4 0b broadcast packet received arp 5 0b arp/ipv4 request packet received ipv4 6 0b directed ipv4 packet received ipv6 7 0b directed ipv6 packet received mng 8 0b indicates that a manageability event that should cause a pme to happen. reserved 15:9 0x0 reserved flx0 16 0b flexible filter 0 match flx1 17 0b flexible filter 1 match flx2 18 0b flexible filter 2 match flx3 19 0b flexible filter 3 match reserved 31:20 0x0 reserved field bit(s) initial value description v40 0 0 ipv4 address 0 valid v41 1 0 ipv4 address 1 valid v42 2 0 ipv4 address 2 valid v43 3 0 ipv4 address 3 valid reserved 15:4 0 reserved v60 16 0 ipv6 address 0 valid reserved 31:17 0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 355 4.4.3.8.5 ipv4 address table ? ip4at (0x05840 + n*8 [n = 0..3]; rw) the ipv4 address table stores the four ipv4 addresses for arp/ipv4 request packet and directed ipv4 packet wake up. it has the following format. 4.4.3.8.6 ipv6 address table ? ip6at (0x05880-0x0588c; rw) the ipv6 address table stores the ipv6 addresses for neighbor discovery packet filtering and directed ipv6 packet wake up and it has the following format. dword# address 31 0 0 0x5840 ipv4addr0 2 0x5848 ipv4addr1 3 0x5850 ipv4addr2 4 0x5858 ipv4addr3 field dword # address bit(s) initial value description ipv4addr0 0 0x5840 31:0 x ipv4 address 0 (least significant byte is first on the wire). ipv4addr1 2 0x5848 31:0 x ipv4 address 1. ipv4addr2 4 0x5850 31:0 x ipv4 address 2. ipv4addr3 6 0x5858 31:0 x ipv4 address 3. ipv4addr 31:0 x ipv4 address dword# address 31 0 0 0x5880 ipv6addr0 1 0x5884 2 0x5888 3 0x588c field dword # address bit(s) initial value description ipv6addr0 0 0x5880 31:0 x ipv6 address 0, bytes 1-4 (least significant byte is first on the wire). 1 0x5884 31:0 x ipv6 address 0, bytes 5-8. 2 0x5888 31:0 x ipv6 address 0, bytes 9-12. 3 0x588c 31:0 x ipv6 address 0, bytes 16-13.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 356 october 2010 4.4.3.8.7 wake up packet length ? wupl (0x05900; r) this register indicates the length of the first wakeup packet received. it is valid if one of the bits in the wake up status (wus) register is set. it is not cleared by any reset. 4.4.3.8.8 wake up packet memory (128 bytes) ? wupm (0x05a00-0x05a7c; r) this register is read only and is used to store the first 128 bytes of the wake up packet for software retrieval after the system wakes. it is not cleared by any reset. 4.4.3.8.9 flexible host filter table registers ? fhft (0x09000 ? 0x093fc; rw) each of the four flexible host filters table registers (fhft) contains a 128-byte pattern and a corresponding 128-bit mask array. if enabled, the first 128 bytes of the received packet are compared against the non-masked bytes in the fhft register. each 128-byte filter is composed of 32 dword entries, where each 2 dwords are accompanied by an 8- bit mask, one bit per filter byte. the length field must be eight-byte aligned. for filtering packets shorter than eight-byte aligned, the values should be rounded up to the next eight-byte aligned value. the hardware implementation compares eight bytes at a time so it should get extra zero masks (if needed) until the end of the length value. if the actual length (defined by the length field register and the mask bits) is not eight-byte aligned, there might be a case in which a packet that is shorter than the actual required length passes the flexible filter. this might happen because of a comparison of up to seven bytes that come after the packet, but that are not really part of the packet. the last dword of each filter contains a length field defining the number of bytes from the beginning of the packet compared by this filter. the length field should be an eight-byte aligned value. if actual packet length is less than (length ? 8; length is the value specified by the length field), the filter fails. otherwise, acceptance depends on the result of actual byte comparison. the value should not be greater than 128. field bit(s) initial value description ipv6addr 31:0 x part of ipv6 address bytes. field bit(s) initial value description len 15:0 x length of wakeup packet. reserved 31:16 0x0 reserved field bit(s) initial value description wupd 31:0 x wake up packet data
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 357 ... ... ... accessing the fhft registers during filter operation might result in a packet being mis-classified if the write operation collides with packet reception. therefore, flex filters should be disabled prior to changing their setup. 4.4.3.9 statistic registers all statistics registers reset when read. in addition, they stick at 0xffff_ffff when the maximum value is reached. for the receive statistics, note that a packet is indicated as received if it passes the 82598?s filters and is placed into the packet buffer memory. a packet does not have to be transferred to host memory in order to be counted as received. 31 8 31 8 7 0 31 0 31 0 reserved reserved mask [7:0] dword 1 dword 0 reserved reserved mask [15:8] dword 3 dword 2 reserved reserved mask [23:16] dword 5 dword 4 reserved reserved mask [31:24] dword 7 dword 6 31 8 31 8 7 0 31 0 31 0 reserved reserved mask [127:120] dword 29 dword 28 length reserved mask [127:120] dword 31 dword 30 field dword address bit(s) initial value filter 0 dword0 0 0x09000 31:0 x filter 0 dword1 1 0x09004 31:0 x filter 0 mask[7:0] 2 0x09008 7:0 x reserved 3 0x0900c x filter 0 dword2 4 0x09010 31:0 x ? filter 0 dword30 60 0x090f0 31:0 x filter 0 dword31 61 0x090f4 31:0 x filter 0 mask[127:120] 62 0x090f8 7:0 x length 63 0x090fc 6:0 x
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 358 october 2010 due to paths between interrupt-generation and logging of relevant statistics counts, it might be possible to generate an interrupt to the system for an event prior to the associated statistics count actually being incremented. this is unlikely due to expected delays associated with the system interrupt-collection and isr delay, but might be observed as an interrupt for which statistics values do not quite make sense. hardware guarantees that any event noteworthy of inclusion in a statistics count is reflected in the appropriate count within 1 s; a small time-delay prior to reading the statistics might be necessary to avoid the potential for receiving an interrupt and observing an inconsistent statistics count as part of the isr. 4.4.3.9.1 crc error count ? crcerrs (0x04000; r) counts the number of receive packets with crc errors. in order for a packet to be counted in this register, it must be 64 bytes or greater (from through inclusively) in length. if receives are not enabled, then this register does not increment. this register counts all packets received, not just packets that are directed to the 82598. 4.4.3.9.2 illegal byte error count ? illerrc (0x04004; r) counts the number of receive packets with illegal bytes errors (an illegal symbol in the packet). this register counts all packets received, not just packets that are directed to the 82598. 4.4.3.9.3 error byte count ? errbc (0x04008; r) counts the number of receive packets with error bytes (an error symbol in the packet). this register counts all packets received, not just packets that are directed to the 82598. 4.4.3.9.4 mac short packet discard count ? mspdc (0x04010; r) field bit(s) initial value description crcerrs 31:0 0x0 crc error count field bit(s) initial value description illerrc 31:0 0x0 illegal byte error count field bit(s) initial value description errbc 31:0 0x0 error byte count field bit(s) initial value description mspdc 31:0 0x0 number of mac short packet discard packets received.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 359 4.4.3.9.5 missed packets count ? mpc (0x03fa0 ? 0x03fbc; r) this counter counts the number of missed packets per packet buffer. packets are missed when the receive fifo has insufficient space to store the incoming packet. this could be caused because of too few buffers allocated, or because there is insufficient bandwidth on the io bus. this register does not increment if receives are not enabled. 4.4.3.9.6 mac local fault count ? mlfc (0x04034; r) 4.4.3.9.7 mac remote fault count ? mrfc (0x04038; r) 4.4.3.9.8 receive length error count ? rlec (0x04040; r) this register counts receive length error events. a length error occurs if an incoming packet length field in the mac header doesn't match the packet length. to enable the receive length error count hlreg.rxlngtherren bit needs to be set to 1b. 4.4.3.9.9 link xon transmitted count ? lxontxc (0x03f60; r) field bit(s) initial value description mpc 31:0 0x0 missed packets count field bit(s) initial value description mlfc 31:0 0x0 number of faults in the local mac. note: for proper counting this statistics should be cleared after link up. note: this statistics field is only valid when the link speed is 10 gb/s. field bit(s) initial value description mrfc 31:0 0x0 number of faults in the remote mac. note: for proper counting this statistics should be cleared after link up. note: this statistics field is only valid when the link speed is 10 gb/s. field bit(s) initial value description rlec 31:0 0x0 number of packets with receive length errors. field bit(s) initial value description lxontxc 31:0 0x0 number of xon packets transmitted.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 360 october 2010 this register counts the number of xon packets received per user priority. xon packets can use the global address, or the station address. 4.4.3.9.10 link xon received count ? lxonrxc (0x0cf60; r) this register counts the number of xon packets transmitted per user priority. these can be either due to queue fullness, or due to software initiated action (using swxoff). 4.4.3.9.11 link xoff transmitted count ? lxofftxc (0x03f68; r) this register counts the number of xoff packets received per user priority. xoff packets can use the global address, or the station address. 4.4.3.9.12 link xoff received count ? lxoffrxc (0x0cf68; r) this register counts the number of xoff packets transmitted per user priority. these can be either due to queue fullness, or due to software initiated action (using swxoff). 4.4.3.9.13 priority xon transmitted count ? pxontxc (0x03f00 ? 0x03f1c; r) this register counts the number of xon packets received per user priority. xon packets can use the global address, or the station address. 4.4.3.9.14 priority xon received count ? pxonrxc (0x0cf00 ? 0x0cf1c; r) field bit(s) initial value description lxonrxc 31:0 0x0 number of xon packets received. field bit(s) initial value description lxofftxc 31:0 0x0 number of xoff packets transmitted. field bit(s) initial value description lxoffrxc 31:0 0x0 number of xoff packets received. field bit(s) initial value description pxontxc 31:0 0x0 number of xon packets transmitted. field bit(s) initial value description pxonrxc 31:0 0x0 number of xon packets received
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 361 this register counts the number of xon packets transmitted per user priority. these can be either due to queue fullness, or due to software initiated action (using swxoff). 4.4.3.9.15 priority xoff transmitted count ? pxofftxc (0x03f20 ? 0x03f3c; r) this register counts the number of xoff packets received per user priority. xoff packets can use the global address, or the station address. 4.4.3.9.16 priority xoff received count ? pxoffrxc (0x0cf20 ? 0x0cf2c; r) this register counts the number of xoff packets transmitted per user priority. these can be either due to queue fullness, or due to software initiated action (using swxoff). 4.4.3.9.17 packets received (64 bytes) count ? prc64 (0x0405c; r) this register counts the number of good packets received that are exactly 64 bytes (from through , inclusively) in length. packets that are counted in the missed packet count register are not counted in this register. this register does not include received flow control packets and increments only if receives are enabled. 4.4.3.9.18 packets received (65-127 bytes) count ? prc127 (0x04060; r) this register counts the number of good packets received that are 65-127 bytes (from through , inclusively) in length. packets that are counted in the missed packet count register are not counted in this register. this register does not include received flow control packets and increments only if receives are enabled. field bit(s) initial value description pxofftxc 31:0 0x0 number of xoff packets transmitted. field bit(s) initial value description pxoffrxc 31:0 0x0 number of xoff packets received. field bit(s) initial value description prc64 31:0 0x0 number of packets received that are 64 bytes in length. field bit(s) initial value description prc127 31:0 0 number of packets received that are 65-127 bytes in length.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 362 october 2010 4.4.3.9.19 packets received (128-255 bytes) count ? prc255 (0x04064; r) this register counts the number of good packets received that are 128-255 bytes (from through , inclusively) in length. packets that are counted in the missed packet count register are not counted in this register. this register does not include received flow control packets and increments only if receives are enabled. 4.4.3.9.20 packets received (256-511 bytes) count ? prc511 (0x04068; r) this register counts the number of good packets received that are 256-511 bytes (from through , inclusively) in length. packets that are counted in the missed packet count register are not counted in this register. this register does not include received flow control packets and increments only if receives are enabled. 4.4.3.9.21 packets received (512-1023 bytes) count ? prc1023 (0x0406c; r) this register counts the number of good packets received that are 512-1023 bytes (from through , inclusively) in length. packets that are counted in the missed packet count register are not counted in this register. this register does not include received flow control packets and increments only if receives are enabled. 4.4.3.9.22 packets received (1024 to max bytes) count ? prc1522 (0x04070; r) this register counts the number of good packets received that are from 1024 bytes to the maximum (from through , inclusively) in length. the maximum is dependent on the current receiver configuration and the type of packet being received. if a packet is counted in receive oversized count, it is not counted in this register (see section 4.4.3.9.32 ). this register does not include received flow control packets and only increments if the packet has passed address filtering and receives are enabled. field bit(s) initial value description prc255 31:0 0x0 number of packets received that are 128-255 bytes in length. field bit(s) initial value description prc511 31:0 0x0 number of packets received that are 256-511 bytes in length. field bit(s) initial value description prc1023 31:0 0x0 number of packets received that are 512-1023 bytes in length. field bit(s) initial value description prc1522 31:0 0x0 number of packets received that are 1024-max bytes in length.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 363 due to changes in the standard for maximum frame size for vlan tagged frames in 802.3, the 82598 accepts packets that have a maximum length of 1522 bytes. rmon statistics associated with this range has been extended to count 1522 byte long packets. 4.4.3.9.23 good packets received count ? gprc (0x04074; r) this register counts the number of good (non-erred) packets received of any legal length. the legal length for the received packet is defined by the value of longpacketenable (see section 4.4.3.9.8 ). the register does not include received flow control packets and only counts packets that pass filtering. it only increments if receives are enabled and does not tally packets counted by the missed packet count (mpc) register. gprc might count packets interrupted by link disconnect although they have a crc error 4.4.3.9.24 broadcast packets received count ? bprc (0x04078; r) this register counts the number of good (non-erred) broadcast packets received. it does not count broadcast packets received when the broadcast address filter is disabled and only increments if receives are enabled. 4.4.3.9.25 multicast packets received count ? mprc (0x0407c; r) this register counts the number of good (non-erred) multicast packets received. it does not tally multicast packets received that fail to pass address filtering or received flow control packets. this register only increments if receives are enabled and does not tally packets counted by the missed packet count (mpc) register. 4.4.3.9.26 good packets transmitted count ? gptc (0x04080; r) field bit(s) initial value description gprc 31:0 0x0 number of good packets received (of any length). field bit(s) initial value description bprc 31:0 0x0 number of broadcast packets received. field bit(s) initial value description mprc 31:0 0x0 number of multicast packets received. field bit(s) initial value description gptc 31:0 0x0 number of good packets transmitted.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 364 october 2010 this register counts the number of good (non-erred) packets transmitted, including flow control packets. a good transmit packet is one that is 64 or more bytes in length (from through , inclusively) in length. the register only increments if transmits are enabled and does not count packets counted by the missed packet count (mpc) register. the register counts clear as well as secure packets. 4.4.3.9.27 good octets received count ? gorc (0x0408c; r) this register counts the number of good (non-erred) octets received, including flow control packets. it includes bytes received in a packet from the destination address field through the crc field, inclusively. in addition, it sticks at 0xffff_ffff when the maximum value is reached. only packets that pass address filtering are counted in this register and it only increments if receives are enabled. 4.4.3.9.28 good octets transmitted count ? gotc (0x04094; r); this register counts the number of good (non-erred) packets transmitted, including flow control packets. in addition, it sticks at 0xffff_ffff when the maximum value is reached. this register includes bytes transmitted in a packet from the destination address field through the crc field, inclusively. it counts octets in successfully transmitted packets and only increments if transmits are enabled. it also counts clear as well as secure octets. 4.4.3.9.29 receive no buffers count ? rnbc (0x03fc0 ? 0x03fdc; r) this register counts the number of times frames were received when there were no available buffers in the appropriate queue to store the frames or the queue was disabled. the packet is still received if there is space in the fifo and the drop_en bit for the target queue is clear (0b). this register only increments if receives are enabled and does not increment when flow control packets are received. field bit(s) initial value description gorc 31:0 0x0 number of good octets received. field bit(s) initial value description gotc 31:0 0x0 number of good octets transmitted. field bit(s) initial value description rnbc 31:0 0x0 number of receive no buffer conditions.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 365 4.4.3.9.30 receive undersize count ? ruc (0x040a4; r) this register counts the number of received frames that passed address filtering, were less than minimum size (64 bytes from through , inclusively), and had a valid crc. it only increments if receives are enabled. 4.4.3.9.31 receive fragment count ? rfc (0x040a8; r) this register counts the number of received frames that pass address filtering, are less than minimum size (64 bytes from through , inclusively), and have a bad crc. this is slightly different from the receive undersize count register. the register only increments if receives are enabled. 4.4.3.9.32 receive oversize count ? roc (0x040ac; r) this register counts the number of received frames that pass address filtering and are greater than maximum size. an oversized packet is defined according to mhadd.mfs. see section 4.4.3.9.21 . if receives are not enabled, the register does not increment. lengths are based on bytes in the received packet from through , inclusively. 4.4.3.9.33 receive jabber count ? rjc (0x040b0; r) this register counts the number of received frames that pass address filtering, are were greater than maximum size and have a bad crc. this is slightly different from the receive oversize count register. if receives are not enabled, the register does not increment. these lengths include bytes in the received packet from through , inclusively. field bit(s) initial value description ruc 31:0 0x0 number of receive undersize errors. field bit(s) initial value description rfc 31:0 0x0 number of receive fragment errors. field bit(s) initial value description roc 31:0 0x0 number of receive oversize errors. field bit(s) initial value description rjc 31:0 0x0 number of receive jabber errors.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 366 october 2010 4.4.3.9.34 management packets received count ? mngprc (0x040b4; r) this register counts the total number of packets received that pass management filters. management packets include rmcp and arp packets. packets with errors are not counted; packets dropped because the management receive fifo is full are counted. 4.4.3.9.35 management packets dropped count ? mngpdc (0x040b8; r) this register counts the total number of packets received that pass the management filters and then are dropped because the management receive fifo is full. management packets include any packet directed to the manageability console, such as rmcp and arp packets. 4.4.3.9.36 management packets transmitted count ? mngptc (0x0cf90; r) this register counts the total number of packets that are transmitted or received over the smbus. 4.4.3.9.37 total octets received ? tor (0x040c4; r); this register counts the total number of octets received. in addition, it sticks at 0xffff_ffff when the maximum value is reached. all packets received passing at least one of the l2 receive filters have their octets summed into this register, regardless of their length, whether they are erred, or whether they are flow control packets. it includes bytes received in a packet from the destination address field through the crc field, inclusively. this register only increments if receives are enabled. broadcast rejected packets are counted in this counter (in contradiction to all other rejected packets that are not counted). field bit(s) initial value description mngprc 31:0 0 number of management packets received. field bit(s) initial value description mngpdc 31:0 0x0 number of management packets dropped. field bit(s) initial value description mngptc 31:0 0x0 number of management packets transmitted. field bit(s) initial value description tor 31:0 0x0 number of total octets received ? upper 4 bytes.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 367 4.4.3.9.38 total packets received ? tpr (0x040d0; r) this register counts the total number of all packets received. all packets received are counted regardless of their length, whether they are erred, or whether they are flow control packets. the register only increments if receives are enabled. broadcast rejected packets are counted in this counter (in contradiction to all other rejected packets that are not counted). tpr might count packets interrupted by link disconnect although they have a crc error. 4.4.3.9.39 total packets transmitted ? tpt (0x040d4; r) this register counts the total number of all packets transmitted. all packets transmitted are counted in this register, regardless of their length, or whether they are flow control packets. partial packet transmissions (collisions in half-duplex mode) are not tallied. this register only increments if transmits are enabled. it counts all packets, including standard packets, secure packets, packets received over the smbus. 4.4.3.9.40 packets transmitted (64 bytes) count ? ptc64 (0x040d8; r) this register counts the number of packets transmitted that are exactly 64 bytes (from through , inclusively) in length, including flow control packets. partial packet transmissions (collisions in half-duplex mode) are not tallied. it only increments if transmits are enabled and counts all other packets, including: standard packets, secure packets, packets received over the smbus. 4.4.3.9.41 packets transmitted (65-127 bytes) count ? ptc127 (0x040dc; r) field bit(s) initial value description tpr 31:0 0x0 number of all packets received. field bit(s) initial value description tpt 31:0 0x0 number of all packets transmitted. field bit(s) initial value description ptc64 31:0 0x0 number of packets transmitted that are 64 bytes in length. field bit(s) initial value description ptc127 31:0 0x0 number of packets transmitted that are 65-127 bytes in length.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 368 october 2010 this register counts the number of packets transmitted that are 65-127 bytes (from through , inclusively) in length. partial packet transmissions (collisions in half-duplex mode) are not tallied. this register only increments if transmits are enabled. this register counts all packets, including: standard packets, secure packets, packets received over the smbus. 4.4.3.9.42 packets transmitted (128-255 bytes) count ? ptc255 (0x040e0; r) this register counts the number of packets transmitted that are 128-255 bytes (from through , inclusively) in length. partial packet transmissions (collisions in half-duplex mode) are not tallied. this register only increments if transmits are enabled and counts all packets, including: standard packets, secure packets, packets received over the smbus. 4.4.3.9.43 packets transmitted (256-511 bytes) count ? ptc511 (0x040e4; r) this register counts the number of packets transmitted that are 256-511 bytes (from through , inclusively) in length. partial packet transmissions (collisions in half-duplex mode) are not included in this register. this register only increments if transmits are enabled and counts all packets, including: standard and secure packets (management packets are never be more than 200 bytes). 4.4.3.9.44 packets transmitted (512-1023 bytes) count ? ptc1023 (0x040e8; r) this register counts the number of packets transmitted that are 512-1023 bytes (from through , inclusively) in length. partial packet transmissions (collisions in half-duplex mode) are not included in this register. this register only increments if transmits are enabled and counts all packets, including: standard and secure packets (management packets are never be more than 200 bytes). 4.4.3.9.45 packets transmitted (greater than 1024 bytes) count ? ptc1522 (0x040ec; r) field bit(s) initial value description ptc255 31:0 0x0 number of packets transmitted that are 128-255 bytes in length. field bit(s) initial value description ptc511 31:0 0x0 number of packets transmitted that are 256-511 bytes in length. field bit(s) initial value description ptc1023 31:0 0x0 number of packets transmitted that are 512-1023 bytes in length. field bit(s) initial value description ptc1522 31:0 0x0 number of packets transmitted that are 1024 or more bytes in length.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 369 this register counts the number of packets transmitted that are 1024 or more bytes (from through , inclusively) in length. this register only increments if transmits are enabled. due to changes in the standard for maximum frame size for vlan tagged frames in 802.3, this device transmits packets which have a maximum length of 1522 bytes. rmon statistics associated with this range has been extended to count 1522 byte long packets. this register counts all packets, including standard and secure packets (management packets are never be more than 200 bytes). 4.4.3.9.46 multicast packets transmitted count ? mptc (0x040f0; r) this register counts the number of multicast packets transmitted, including flow control packets. counts clear as well as secure traffic. 4.4.3.9.47 broadcast packets transmitted count ? bptc (0x040f4; r) this register counts the number of broadcast packets transmitted. it only increments if transmits are enabled and counts all packets, including standard and secure packets (management packets are never be more than 200 bytes). after a broadcast packet is sent by the host, all flow control and manageability packets that are sent are counted as broadcast packets until a non-broadcast packet is sent by the host. 4.4.3.9.48 xsum error count ? xec (0x04120; ro) xsum errors are not counted when a packet has mac error (crc, length, under-size, over-size, byte error or symbol error). 4.4.3.9.49 receive queue statistic mapping registers rqsmr (0x2300 + 4*n [n=0?15], rw) these registers define the mapping of the receive queues to the per-queue statistics. this mapping maps the queues to statistic registers qprc and qbrc (note that there are 16 of each). there are 64 queues and only 16 queue statistics registers so each entry refers to a queue and the value indicates which qprc and qbrc of the 16 this queue statistics is being counted. several queues can be mapped to a single statistic register. each statistic register counts the number of packets and bytes of all queues that are mapped to that statistics. field bit(s) initial value description mptc 31:0 0x0 number of multicast packets transmitted. field bit(s) initial value description bptc 31:0 0x0 number of broadcast packets transmitted count. field bit(s) initial value description xec 31:0 0x0 number of receive ipv4, tcp, udp checksum errors
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 370 october 2010 ... ... ... 4.4.3.9.50 transmit queue statistic mapping registers tqsmr (0x7300 + 4*n [n=0?7], rw) these registers define the mapping of the transmit queues to the per-queue statistics. this mapping maps the queues to statistic registers qptc and qbtc (note that there are 16 of each). there are 64 queues and only 16 queue statistics registers so each entry refers to a queue and the value indicates which qptc and qbtc of the 16 this queue statistics is being counted. several queues can be mapped to a single statistic register. each statistic register counts the number of packets and bytes of all queues that are mapped to that statistics. . . . 31 ?.24 23 16 15 8 7 0 q_map[3] q_map[2] q_map[1] q_map[0] ???? ???? q_map[63] q_map[62] q_map[61] q_map[60] field bit(s) initial value description q_map[0] 3:0 0x0 defines the per-queue statistic register that is mapped to this queue. reserved 7:4 0x0 reserved q_map[1] 11:8 0x0 defines the per-queue statistic register that is mapped to this queue. reserved 15:12 0x0 reserved q_map[2] 19:16 0x0 defines the per-queue statistic register that is mapped to this queue. reserved 23:20 0x0 reserved q_map[3] 27:24 0x0 defines the per-queue statistic register that is mapped to this queue. reserved 31:28 0x0 reserved 31 ?.24 23 16 15 8 7 0 q_map[3] q_map[2] q_map[1] q_map[0] ????
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 371 4.4.3.9.51 queue packets received count ? qprc (0x01030+ n*0x40[n=0..15]; r) 4.4.3.9.52 queue packets transmitted count ? qptc (0x06030 + n*0x40[n=0..15]; r) 4.4.3.9.53 queue bytes received count ? qbrc (0x1034 + n*0x40[n=0..15]; r) ???? q_map[31] q_map[30] q_map[29] q_map[28] field bit(s) initial value description q_map[0] 3:0 0x0 defines the per-queue statistic register that is mapped to this queue. reserved 7:4 0x0 reserved q_map[1] 11:8 0x0 defines the per-queue statistic register that is mapped to this queue. reserved 15:12 0x0 reserved q_map[2] 19:16 0x0 defines the per-queue statistic register that is mapped to this queue. reserved 23:20 0x0 reserved q_map[3] 27:24 0x0 defines the per-queue statistic register that is mapped to this queue. reserved 31:28 0x0 reserved field bit(s) initial value description qprc 31:0 0x0 number of packets received for the queue. field bit(s) initial value description qptc 31:0 0x0 number of packets transmitted for the queue. field bit(s) initial value description qbrc 31:0 0x0 number of bytes received for the queue.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 372 october 2010 4.4.3.9.54 queue bytes transmitted count ? qbtc (0x6034+n*0x40[n=0..15]; r) 4.4.3.10 management filter registers 4.4.3.10.1 management vlan tag value ? mavtv (0x5010 +4*n[n=0..7]; rw) where "n" is the vlan filter serial number, equal to 0, 1,?7. mavtv registers are written by the bmc and are not accessible to the host for writing. the registers are used to filter manageability packets. 4.4.3.10.2 management flex udp/tcp ports ? mfutp (0x5030 + 4*n[n=0..7]; rw) where each 32-bit register (n=0,?,7) refers to two port filters (register 0 refers to ports 0 and 1, register 1 refers to port 2 and 3, etc). mfutp registers are written by the bmc and not accessible to the host for writing. reset ? mfutp registers are cleared on internal power on reset or lan_pwr_good only. the initial values for this register can be loaded from the eeprom by the management firmware after power-up reset. mfutp registers value should be configured to the register in host order. 4.4.3.10.3 management control register ? manc (0x05820; rw) field bit(s) initial value description qbtc 31:0 0x0 number of bytes transmitted for the queue. field bit(s) initial value description vid 11:0 0x0 contains the vlan id that should be compared with the incoming packet if bit 31 is set. reserved 31:12 0x0 reserved field bit(s) initial value description mfutp[2n] 15:0 0x0 (2n)-th management flex udp/tcp port. mfutp[2n+1] 31:16 0x0 (2n+1)-th management flex udp/tcp port. field bit(s) initial value description reserved 16:0 0x0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 373 4.4.3.10.4 manageability filters valid ? mfval (0x5824; rw) the manageability filters valid registers indicate which filter registers contain a valid entry. reset ? the mfval register is cleared on internal power on reset or lan_pwr_good reset. rcv_tco_en 17 0b receive tco packets enabled when this bit is set, it enables the receive flow from the wire to the manageability block. reserved 18 0b reserved rcv_all 19 0b receive all enable when set, all packets are received from the wire and passed to the manageability block. mcst_pass_l2 20 0b multicast promiscuous when set, all multicast filters pass l2 address filtering (same as the host promiscuous multicast. en_mng2host 21 0b enable manageability packets to host memory this bit enables the functionality of the manc2h register. when set, the packets that are specified in the manc2h registers are also forwarded to the host memory, if they pass manageability filters. reserved 22 0b reserved en_xsum_filter 23 0b enable checksum filtering to manageability when set, only packets that pass l3 and l4 checksums are sent to the manageability block. en_ipv4_filter 24 0b enable ipv4 address filters when set, the last 128 bits of the mipaf register are used to store four ipv4 addresses for ipv4 filtering. when cleared, these bits store a single ipv6 filter. fixed_net_type 25 0b fixed next type enable if set, only packets matching the net type defined by the net_type field (bit 26 in this register) passes to manageability. net_type 26 0b net type 0b = pass only un-tagged packets. 1b = pass only vlan tagged packets. valid only if fixed_net_type (bit 25) is set. packet has to pass one mdef/ rcv_all in order to be checked by this rule. reserved 31:27 0x0 reserved field bit(s) initial value description mac 3:0 0x0 1 mac indicates if the mac unicast filter registers (mmah and mmal) contain valid mac addresses. bit 0 corresponds to filter 0, etc. reserved 7:4 0x0 1 reserved vlan 15:8 0x0 1 vlan indicates if the vlan filter registers (mavtv) contain valid vlan tags. bit 8 corresponds to filter 0, etc.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 374 october 2010 4.4.3.10.5 management control to host register ? manc2h (0x5860; rw) the manc2h register enables routing of manageability packets to the host based on the decision filter that routed the packet to the manageability micro-controller. each manageability decision filter (mdef) has a corresponding bit in the manc2h register. when a manageability decision filter (mdef) routes a packet to manageability, it also routes the packet to the host if the corresponding manc2host bit is set and if the en_mng2host bit is set. the en_mng2host bit serves as a global enable for the manc2h bits. reset ? the manc2h register is cleared on internal power on reset or lan_pwr_good, and firmware reset. 4.4.3.10.6 manageability decision filters- mdef (0x5890 + 4*n[n=0..7]; rw) reset ? the mdef registers are cleared on internal power on reset or lan_pwr_good reset. ipv4 19:16 0x0 1 ipv4 indicates if the ipv4 address filters (mipaf) contain valid ipv4 addresses. bit 16 corresponds to ipv4 address 0. these bits apply only when ipv4 address filters are enabled (manc.en_ipv4_filter=1b) reserved 23:20 0x0 1 reserved ipv6 27:24 0x0 1 ipv6 indicates if the ipv6 address filter registers (mipaf) contain valid ipv6 addresses. bit 24 corresponds to address 0, etc. bit 27 (filter 3) applies only when ipv4 address filters are not enabled (manc.en_ipv4_filter=0b). reserved 31:28 0x0 1 reserved 1. the initial values for this register can be loaded from the eeprom by the management firmware after power-up reset or firmwar e reset. the mfval register is written by the bmc and not accessible to the host for writing. field bit(s) initial value description host enable 7:0 0x0 1 1. the initial values for this register can be loaded from the eeprom by the management firmware after power-up reset or firmwar e reset. host enable when set, indicates that packets routed by the manageability filters to manageability are also sent to the host. bit 0 corresponds to decision rule 0, etc. reserved 31:8 0x0 reserved field bit(s) initial value description unicast and 0 0b 1 unicast controls the inclusion of unicast address filtering in the manageability filter decision (and section). broadcast and 1 0b 1 broadcast controls the inclusion of broadcast address filtering in the manageability filter decision (and section).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 375 vlan and 2 0b 1 vlan controls the inclusion of vlan address filtering in the manageability filter decision (and section). ip address 3 0b 1 ip address controls the inclusion of ip address filtering in the manageability filter decision (and section). unicast or 4 0b 1 unicast controls the inclusion of unicast address filtering in the manageability filter decision (or section). broadcast or 5 0b 1 broadcast controls the inclusion of broadcast address filtering in the manageability filter decision (or section). multicast and 6 0b 1 multicast controls the inclusion of multicast address filtering in the manageability filter decision (and section). broadcast packets are not included by this bit. the packet must pass some l2 filtering to be included by this bit ? either by the manc.mcst_pass_l2 or by some dedicated mac address. arp request 7 0b 1 arp request controls the inclusion of arp request filtering in the manageability filter decision (or section). arp response 8 0b 1 arp response controls the inclusion of arp response filtering in the manageability filter decision (or section). reserved 9 0b 1 reserved port 0x298 10 0b 1 port 0x298 controls the inclusion of port 0x298 filtering in the manageability filter decision (or section). port 0x26f 11 0b 1 port 0x26f controls the inclusion of port 0x26f filtering in the manageability filter decision (or section). field bit(s) initial value description flex port 27:12 0x0 1 flex port controls the inclusion of flex port filtering in the manageability filter decision (or section). bit 12 corresponds to flex port 0, etc. flex tco 31:28 0x0 1 flex tco controls the inclusion of flex tco filtering in the manageability filter decision (or section). bit 28 corresponds to flex tco filter 0, etc. 1. the initial values for this register can be loaded from the eeprom by the management firmware after power-up reset or firmwar e reset.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 376 october 2010 4.4.3.10.7 manageability ip address filter ? mipaf (0x58b0-0x58ec; rw) the manageability ip address filter register stores ip addresses for manageability filtering. the mipaf register can be used in two configurations, depending on the value of the manc. en_ipv4_filter bit: ? en_ipv4_filter = 0b: the last 128 bits of the register store a single ipv6 address (ipv6addr3) ? en_ipv4_filter = 1bs: the last 128 bits of the register store four ipv4 addresses (ipv4addr[3:0]) reset ? these registers are cleared on internal power on reset or lan_pwr_good only. mipaf registers value should be configured to the register in host order. en_ipv4_filter = 0b: dword# address 31 0 0 0x58b0 ipv6addr0 1 0x58b4 2 0x58b8 3 0x58bc 4 0x58c0 ipv6addr1 5 0x58c4 6 0x58c8 7 0x58cc 8 0x58d0 ipv6addr2 9 0x58d4 10 0x58d8 11 0x58dc 12 0x58e0 ipv6addr3 13 0x58e4 14 0x58e8 15 0x58ec field dword # address bit(s) initial value description 0 0x58b0 31:0 x 1 ipv6 address 0, bytes 1-4 (least significant byte is first on the wire) ipv6addr0 1 0x58b4 31:0 x 1 ipv6 address 0, bytes 5-8 2 0x58b8 31:0 x 1 ipv6 address 0, bytes 9-12
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 377 en_ipv4_filter = 1b: 3 0x58bc 31:0 x 1 ipv6 address 0, bytes 16-13 0 0x58c0 31:0 x 1 ipv6 address 1, bytes 1-4 (least significant byte is first on the wire) ipv6addr1 1 0x58c4 31:0 x 1 ipv6 address 1, bytes 5-8 2 0x58c8 31:0 x 1 ipv6 address 1, bytes 9-12 3 0x58cc 31:0 x 1 ipv6 address 1, bytes 16-13 0 0x58d0 31:0 x 1 ipv6 address 2, bytes 1-4 (least significant byte is first on the wire) ipv6addr2 1 0x58d4 31:0 x 1 ipv6 address 2, bytes 5-8 2 0x58d8 31:0 x 1 ipv6 address 2, bytes 9-12 3 0x58dc 31:0 x 1 ipv6 address 2, bytes 16-13 0 0x58e0 31:0 x 1 ipv6 address 3, bytes 1-4 (least significant byte is first on the wire) ipv6addr3 1 0x58e4 31:0 x 1 ipv6 address 3, bytes 5-8 2 0x58e8 31:0 x 1 ipv6 address 3, bytes 9-12 3 0x58ec 31:0 x 1 ipv6 address 3, bytes 16-13 1. the initial values for these registers can be loaded from the eeprom after power-up reset. the registers are written by the b mc and not accessible to the host for writing. dword# address 31 0 0 0x58b0 1 0x58b4 ipv6addr0 2 0x58b8 3 0x58bc 4 0x58c0 5 0x58c4 ipv6addr1 6 0x58c8 7 0x58cc 8 0x58d0 9 0x58d4 ipv6addr2 10 0x58d8 11 0x58dc 12 0x58e0 ipv4addr0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 378 october 2010 13 0x58e4 ipv4addr1 14 0x58e8 ipv4addr2 15 0x58ec ipv4addr3 field dword # address bit(s) initial value description 0 0x58b0 31:0 x 1 1. the initial values for these registers can be loaded from the eeprom after power-up reset. the registers are written by the b mc and not accessible to the host for writing. ipv6 address 0, bytes 1-4 (least significant byte is first on the wire) ipv6addr0 1 0x58b4 31:0 x 1 ipv6 address 0, bytes 5-8 2 0x58b8 31:0 x 1 ipv6 address 0, bytes 9-12 3 0x58bc 31:0 x 1 ipv6 address 0, bytes 16-13 0 0x58c0 31:0 x 1 ipv6 address 1, bytes 1-4 (least significant byte is first on the wire) ipv6addr1 1 0x58c4 31:0 x 1 ipv6 address 1, bytes 5-8 2 0x58c8 31:0 x 1 ipv6 address 1, bytes 9-12 3 0x58cc 31:0 x 1 ipv6 address 1, bytes 16-13 0 0x58d0 31:0 x 1 ipv6 address 2, bytes 1-4 (least significant byte is first on the wire) ipv6addr2 1 0x58d4 31:0 x 1 ipv6 address 2, bytes 5-8 2 0x58d8 31:0 x 1 ipv6 address 2, bytes 9-12 3 0x58dc 31:0 x 1 ipv6 address 2, bytes 16-13 ipv4addr0 0 0x58e0 31:0 x 1 ipv4 address 0 (least significant byte is first on the wire) ipv4addr1 1 0x58e4 31:0 x 1 ipv4 address 1 (least significant byte is first on the wire) ipv4addr2 2 0x58e8 31:0 x 1 ipv4 address 2 (least significant byte is first on the wire) ipv4addr3 3 0x58ec 31:0 x 1 ipv4 address 3 (least significant byte is first on the wire)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 379 4.4.3.10.8 manageability mac address low ? mmal (0x5910 + 8*n[n=0..3]; rw) these registers contain the lower bits of the 48-bit ethernet address. mmal registers are written by the bmc and not accessible to the host for writing. they are used to filter manageability packets. reset ? mmal registers are cleared on internal power on reset or lan_pwr_good only. the mmal value should be configured to the register in host order. 4.4.3.10.9 manageability mac address high ? mmah (0x5914 + 8*n[n=0..3]; rw) these registers contain the upper bits of the 48-bit ethernet address. the complete address is {mmah, mmal}. mmah registers are written by the bmc and not accessible to the host for writing. they are used to filter manageability packets. reset ? mmal registers are cleared on internal power on reset or lan_pwr_good only. the mmah value should be configured to the register in host order. 4.4.3.10.10 flexible tco filter table registers ? ftft (0x09400-0x097fc; rw) each of the four flexible tco filters table registers (ftft) contains a 128-byte pattern and a corresponding 128-bit mask array. if enabled, the first 128 bytes of the received packet are compared against the non-masked bytes in the ftft register. field bit(s) initial value description ip_addr 4 bytes 31:0 x 1 1. the initial values for these registers can be loaded from the eeprom after power-up reset. the registers are written by the b mc and not accessible to the host for writing. four bytes of ip (v6 or v4) address i mod 4 = 0 to bytes 1 ? 4 i mod 4 = 1 to bytes 5 ? 8 i mod 4 = 0 to bytes 9 ? 12 i mod 4 = 0 to bytes 13 ? 16 where i div four is the index of ip address (0..3). field bit(s) initial value description mmal 31:0 x 1 1. the initial values for this register can be loaded from the eeprom by the management firmware after power-up reset. manageability mac address low the lower 32 bits of the 48-bit ethernet address. field bit(s) initial value description mmah 15:0 x 1 1. the initial values for this register can be loaded from the eeprom by the management firmware after power-up reset. manageability mac address high the upper 16 bits of the 48-bit ethernet address. reserved 31:16 0x0 reserved reads as 0x0. ignored on writes.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 380 october 2010 each 128-byte filter is composed of 32 dword entries, where each two dwords are accompanied by an 8-bit mask, one bit per filter byte. the bytes in each two dwords are written in host order. for example, byte0 written to bits [7:0], byte1 to bits [15:8] etc. the mask field is set so that bit0 in the mask masks byte0, bit 1 masks byte 1 etc. a value of one in the mask field means that the appropriate byte in the filter should be compared to the appropriate byte in the incoming packet. note: the mask field must be 8bytes aligned even if the length field is not 8 bytes aligned as the hardware implementation compares 8 bytes at a time so it should get extra masks until the end of the next qword. any mask bit that is located after the length should be set to zero indicating no comparison should be done. note: if the actual length, which is defined by the length field register and the mask bits, is not 8 bytes aligned there might be a case that a packet which is shorter than the actual required length pass the flexible filter. this can happen due to comparison of up to 7 bytes that come after the packet but are not a real part of the packet. the last dword of each filter contains a length field defining the number of bytes from the beginning of the packet compared by this filter. if actual packet length is less than the length specified by this field, the filter fails. otherwise, it depends on the result of actual byte comparison. the value should not be greater than 128. the initial values for the ftft registers can be loaded from the eeprom after power-up reset. the ftft registers are written by the bmc and not accessible to the host for writing. the registers are used to filter manageability packets. reset ? the ftft registers are cleared on internal power on reset or lan_pwr_good only. ????.. 31 8 31 8 7 0 31 0 31 0 reserved reserved mask [7:0] dword 1 dword 0 reserved reserved mask [15:8] dword 3 dword 2 reserved reserved mask [23:16] dword 5 dword 4 reserved reserved mask [31:24] dword 7 dword 6 31 8 31 8 7 0 31 0 31 0 reserved reserved mask [127:120] dword 29 dword 28 length reserved mask [127:120] dword 31 dword 30 field dword address bit(s) initial value filter 0 dword0 0 0x09400 31:0 x filter 0 dword1 1 0x09404 31:0 x filter 0 mask[7:0] 2 0x09408 7:0 x reserved 3 0x0940c x
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 381 4.4.3.11 pcie registers 4.4.3.11.1 pcie control register ? gcr (0x11000; rw) filter 0 dword2 4 0x09410 31:0 x ? filter 0 dword30 60 0x094f0 31:0 x filter 0 dword31 61 0x094f4 31:0 x filter 0 mask[127:120] 62 0x094f8 7:0 x length 63 0x094fc 6:0 x field bit (s) initial value description reserved 0 0b reserved reserved 1 0b reserved reserved 2 0b reserved cbmrx 3 0b i/oat message received this bit indicates that an i/oat message was received by the 82598. reserved 7:4 x reserved fw self-reset 8 0b when set, firmware performs a self reset. rx_l0s_ adjustment 91b if set, the replay timer always adds the required l0s adjustment. when 0b. the replay timer adds it only when tx l0s is active. reserved 11:10 00b reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 382 october 2010 completion_ timeout_value 15:12 0000b 1 indicates the selected value for completion timeout. decoding of this field depends on the pcie capability version: capability version 0x1: 0000b = 50 s to 10 ms (default). 0001b = 10 ms to 250 ms. 0010b = 250 ms to 4 s. 0011b = 4 s to 64 s. other = reserved. capability version 0x2: 0000b = 50 s to 50 ms. 0001b = 50 s to 100 s. 0010b = 1 ms to 10 ms. 0011b = reserved. 0100b = reserved. 0101b = 16 ms to 55 ms. 0110b = 65 ms to 210 ms. 0111b = reserved. 1000b = reserved. 1001b = 260 ms to 900 ms. 1010b = 1 s to 3.5 s. 1011b = reserved. 1100b = reserved. 1101b = 4 s to 13 s. 1110b = 17 s to 64 s. 1111b = reserved. note: for capability version 2, this field is read only. completion_ timeout_ resend 16 1b 1 when set, enables a resend request after the completion timeout expires. 0b = do not resend request after completion timeout. 1b = resend request after completion timeout. completion_ timeout_ disable 17 0b 1 indicates if the pcie completion timeout is supported. 0b = completion timeout enabled. 1b = completion timeout disabled. field bit (s) initial value description pcie capability version 18 1b 1 reports the pcie capability version supported. 0b = capability version: 0x1. 1b = capability version: 0x2. reserved 19 0b reserved apbacd 20 0b auto pba clear disable when set to 0b, pba entry is cleared on the falling edge of the appropriate interrupt request to the pcie block. hdr_log inversion 21 0b if set the header log in error reporting is written as 31:0 to log1, 63:643 in log2, etc. if not, the header is written as 127:96 in log1, 95:64 in log 2, etc. reserved 22 1b reserved must be set to 1b. reserved 23 0b reserved l0s_entry_ latency 24 0b l0s entry latency set to 0b to indicate that the l0s entry latency is the same as l0s exit latency. set to 1b to indicate that the l0s entry latency is the same as l0s exit latency/4.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 383 4.4.3.11.2 pcie timer value ? gtv (0x11004; rw) 4.4.3.11.3 function-tag register functag (0x11008; rw) reserved 26:25 11b 1 reserved reserved 27 0b reserved gio_dis_rd_err 28 0b disable running disparity error of the pcie 108b decoders. gio_good_l0s 29 0b force good pcie l0s training. self_test_result 30 0b if set, the self test result finished successfully. reserved 31 0b reserved 1. initial value is loaded from the eeprom. field bit(s) initial value description rtvalue 14:0 0x1000 replay timer value value is in units of 4 ns. reserved 30:15 0x0 reserved rtvalid 31 0b replay timer valid when set to 1b, rtvalue is used for the timeout value for tlp packet retransmission. field bit(s) initial value description cnt_3_tag 31:29 0x0 tag number for event 6/1d, if located in counter 3. cnt_3_func 28:24 0x0 function number for event 6/1d, if located in counter 3. cnt_2_tag 23:21 0x0 tag number for event 6/1d, if located in counter 2. cnt_2_func 20:16 0x0 function number for event 6/1d, if located in counter 2. cnt_1_tag 15:13 0x0 tag number for event 6/1d, if located in counter 1. cnt_1_func 12:8 0x0 function number for event 6/1d, if located in counter 1. cnt_0_tag 7:5 0x0 tag number for event 6/1d, if located in counter 0. cnt_0_func 4:0 0x0 function number for event 6/1d, if located in counter 0.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 384 october 2010 4.4.3.11.4 pcie latency timer ? glt (0x1100c; rw) 4.4.3.11.5 function active and power state to manageability ? factps (0x10150; ro) this register is for use by the firmware for configuration. field bit(s) initial value description ltvalue 14:0 0x40 latency timer value value is in units of 4 ns. reserved 30:15 0x0 reserved ltvalid 31 0b latency timer valid when set to 1b, ltvalue is used for the maximum latency before sending ack/ nack. field bit(s) initial value description pm state changed 31 0b indication that one or more of the functions power states had changed. this bit is also a signal to the manageability unit to create an interrupt. this bit is cleared on read, and is not set for at least eight cycles after it was cleared. lan function sel 30 0b 1 when lan function sel equals 0b, lan 0 is routed to pci function 0 and lan 1 is routed to pci function 1. if the lan function sel equals 1b, lan 0 is routed to pci function 1 and lan 1 is routed to pci function 0. mngcg 29 0b manageability clock gated when set indicates that the manageability clock is gated. reserved 28:10 00b reserved func1 aux_en 9 0b function 1 auxiliary (aux) power pm enable bit shadow from the configuration space lan1 valid 8 0b lan 1 enable when this bit is 0b, it indicates that the lan 0 function is disabled. when the function is enabled, the bit is 1b. this bit reflects if the function is disabled through the external pad func1 power state 7:6 00b power state indication of function 1. 00b -> dr. 01b -> d0u. 10b -> d0a. 11b -> d3. reserved 5:4 00b reserved func0 aux_en 3 0b function 0 auxiliary (aux) power pm enable bit shadow from the configuration space.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 385 4.4.3.11.6 pcie analog configuration register ? pcieanactl (0x11040; rw) this register is for use by the device hardware for configuring analog circuits in the pcie block. 4.4.3.11.7 software semaphore register ? swsm (0x10140; rw) lan0 valid 2 0b lan 0 enable when this bit is 0b, it indicates that the lan 0 function is disabled. when the function is enabled, the bit is 1b. this bit reflects if the function is disabled through the external pad. func0 power state 1:0 00b power state indication of function 0 00b -> dr. 01b -> d0u. 10b -> d0a. 11b -> d3. 1. this bit is initiated from the eeprom. field bit(s) initial value description done indication 31 1 when a write operation completes, this bit is set to 1b indicating that new data can be written. this bit is over written to 0b by new data. reserved 30:20 0 reserved target 19:16 0 analog target to the configuration. 0000b = lane 0 0001b = lane 1 0010b = lane 2 0011b = lane 3 0100b = lane 4 0101b = lane 5 0110b = lane 6 0111b = lane 7 1000b = all lanes 1001b = scc pll 1010b:1111b ? reserved address 15:8 0 address to pcie analog registers. data 7:0 0 data to pcie analog registers. field bit(s) initial value description smbi 0 0x0 semaphore bit this bit is set by hardware, when this register is read by the software device driver and cleared when the host driver writes 0b to it. the first time this register is read, the value is 0b. in the next read, the value is 1b (hardware mechanism). the value remains 1b until the software device driver clears it. this bit is cleared on gio soft reset.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 386 october 2010 4.4.3.11.8 firmware semaphore register ? fwsm (0x10148; rw) swesmbi 1 0x0 software eeprom semaphore bit this bit should be set only by the software device driver (read-only to firmware). the bit is not set if bit 0 in the fwsm register is set. the software device driver should set this bit and then read it to see if it was set. if it was set, it means that the software device driver can read/write from/to the eeprom. the software device driver should clear this bit when finishing its eeprom?s access. hardware clears this bit on gio soft reset. wmng 2 0x0 wake manageability clock when this bit is set the hardware wakes the manageability clock if gated. asserting this bit does not clear the cfg_done bit in the eemngctl register. this bit is self cleared on writes. reserved 31:3 0x0 reserved. field bit(s) initial value description eep_fw_ semaphore 00b eeprom firmware semaphore firmware should set this bit to 1b before accessing the eeprom. if software using the swsm does not lock the eeprom, firmware is able to set it to 1b. firmware should set it to 0b after completing an eeprom access. fw_mode 3:1 0x0 firmware mode indicates the firmware mode as follows: 0x0 = none (manageability off). 0x1 = reserved 0x2 = pass through (pt) mode 0x3 = reserved 0x4 = host interface enable only. else = reserved reserved 5:4 00b reserved eep_reload_ ind 6 0b eeprom reloaded indication set to 1b after firmware reloaded eeprom. cleared by firmware once the clear bit host command is received from host software. reserved 14:7 0x0 reserved fw_val_bit 15 0b firmware valid bit hardware clears this bit in reset de-assertion so software can know firmware mode (bits 1-5) is invalid. firmware should set it to 1b when it is ready (end of boot sequence). reset_cnt 18:16 0x0 reset counter firmware increments this field after every reset.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 387 note: this register should be written only by manageability firmware. the software device driver should only read this register. note: firmware ignores the eeprom semaphore in operating system hung states. bits 15:0 are cleared on firmware reset. 4.4.3.11.9 general software semaphore register ? gssr (0x10160; rw) ext_err_ind 24:19 0x0 external error indication firmware writes here the reason that the firmware has reset/clock gated (eeprom, flash, patch corruption, etc.). possible values: 0x00 = no error. 0x01 = invalid eeprom checksum. 0x02 = unlocked secured eeprom. 0x03 = clock off host command. 0x04 = invalid flash checksum. 0x05 = c0 checksum failed. 0x06 = c1 checksum failed. 0x07 = c2 checksum failed. 0x08 = c3 checksum failed. 0x09 = tlb table exceeded. 0x0a = dma load failed. 0x0b = bad hardware version in patch load. 0x0c = flash device not supported in the 82598. 0x0d = unspecified error. 0x3f = reserved ? maximum error value. pcie_config_ err_ind 25 0b pcie configuration error indication set to 1b by firmware when it fails to configure pcie interface. cleared by firmware upon successful configuration of pcie interface. phy_serdes0_ config_ err_ind 26 0b phy/serdes0 configuration error indication set to 1b by firmware when it fails to configure phy/serdes of lan0. cleared by firmware upon successful configuration of phy/serdes of lan0. field bit(s) initial value description phy_serdes1_ config_ err_ind 27 0b phy/serdes1 configuration error indication set to 1b by firmware when it fails to configure phy/serdes of lan1. cleared by firmware upon successful configuration of phy/serdes of lan1. unlock_eep 28 0b unlock eeprom set to 1b by software in order to enable re-writing to the eeprom at address 0x00 (eeprom control word 1). cleared by firmware once eeprom control word 1 is unlocked. reserved 31:29 0x0 reserved field bit(s) initial value description smbits 9:0 0 semaphore bits each bit represents a different software semaphore. hardware implementation is read/write registers. bits 4:0 are owned by software while bits 9:5 are owned by firmware. hardware does not lock access to these bits.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 388 october 2010 smbits are reset on internal power on reset or lan_pwr_good. software and firmware synchronize accesses to shared resources in the 82598 through a semaphore mechanism and a shared configuration register. the swesmbi bit in the software semaphore (swsm) register and the eep_fw_semaphore bit in the firmware semaphore (fwsm) register serve as a semaphore mechanism between software and firmware. once software or firmware takes control over the semaphore, it might access the general software semaphore (gssr) register and claim ownership of a specific resource. the gssr includes pairs of bits (one owned by software and the other by firmware), where each pair of bits control a different resource. a resource is owned by software or firmware when the respective bit is set. note that it is illegal to have both bits in a pair set at the same time. the software/firmware interface uses the following bit assignment convention for the gssr semaphore bits. when software or firmware gains control over the gssr, it checks if a certain resource is owned by the other (the bit is set). if not, it might set its bits for that resource, taking ownership of the resource. the same process (claiming the semaphore and accessing the gssr) is done when a resource is being freed. the following example shows how software might use this mechanism to own a resource (firmware accesses are done in an analogous manner): 1. software takes control over the software/firmware semaphore. reserved 30:10 0 reserved regsmp 31 0 register semaphore this bit is used to semaphore the access to this register (not hardware block). when the bit value is 0b and the register is read, the read transaction shows 0b and the bit is set (next read reads as 1b). writing 0b to this bit clears it. a software device driver that reads this register and gets the value of 0b for this bit locks the access to this register until it clears this bit. note: no hardware lock for register access. field bit description sw_eep_sm 0 when set to 1b eeprom access is owned by software sw_phy_sm0 1 when set to 1b, phy 0 access is owned by software sw_phy_sm1 2 when set to 1b, phy 1 access is owned by software sw_mac_csr_sm 3 when set to 1b, software owns access to shared csrs sw_flash_sm 4 software flash semaphore fw_eep_sm 5 when set to 1b, eeprom access is owned by firmware fw_phy_sm0 6 when set to 1b, phy 0 access is owned by firmware fw_phy_sm1 7 when set to 1b, phy 1 access is owned by firmware fw_mac_csr_sm 8 when set to 1b, firmware owns access to shared csrs reserved 9 reserved for future firmware use
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 389 a. software writes a 1b to the swesmbi bit in the swsm. b. software reads the swesmbi bit. if set, software owns the semaphore. if cleared, this is an indication that firmware currently owns the semaphore. software should retry the previous step after some delay. 2. software reads the gssr and checks the firmware bit in the pair of bits that control the resource is wishes to own. a. if the bit is cleared (firmware does not own the resource), software sets the software bit in the pair of bits that control the resource is wishes to own. b. if the bit is set (firmware owns the resource), go to step 4. 3. software releases the software/firmware semaphore by clearing the swesmbi bit in the swsm. 4. if software did not succeed in owning the resource (from step 2b), software repeats the process after some delay. the following example shows how software might use this mechanism to release a resource (firmware accesses are done in an analogous manner): 1. software takes control over the software/firmware semaphore. a. software writes a 1b to the swesmbi bit in the swsm. b. software then reads the swesmbi bit. if set, software owns the semaphore. if cleared, this is an indication that firmware currently owns the semaphore. software should retry the previous step after some delay. 2. software writes a 0b to the software bit in the pair of bits that control the resource is wishes to release in the gssr. 3. software releases the software/firmware semaphore by clearing the swesmbi bit in the swsm. 4. software waits some delay before trying to gain the semaphore again. the following are time periods used by firmware. in a similar way, the sw_flash_sm is used to synchronize between the two software device drivers on the flash resource to make sure both drivers are not accessing the flash at the same time. a software device driver that wants to access the flash, first checks the state of the sw_flash_sm bit, and if set, does not access the flash (used by the other software device). if it is cleared, the software device driver sets the semaphore and then accesses the flash. once the software device driver completes all flash accesses, it releases the semaphore and enables the other software device driver to access the flash. description time time to backoff from a failed attempt to get the software/firmware semaphore to the next attempt. 5 ms time after which to access the gssr register, by force, if the software/firmware semaphore is still unavailable. 10 ms time after which to access the eeprom, by force, if gssr.eep_sm still not available. 1 s time after which to access phy 0, by force, if gssr.phy_sm0 still not available. 1 s time after which to access phy 1, by force, if gssr.phy_sm1 still not available. 1 s time after which to access the mac csr mechanism, by force, if gssr.mac_csr_sm is still not available. 10 ms
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 390 october 2010 4.4.3.11.10 mirrored revision id- mrevid (0x11064; ro) 4.4.3.12 dca control registers 4.4.3.12.1 dca requester id information register- dca_id (0x11070; r) to ease software implementation, a dca requester id field, composed of device id, bus # and function # is set up in mmio space for software to program the chipset dca requester id authentication register. 4.4.3.12.2 dca control register- dca_ctrl (0x11074; rw) field bit(s) initial value description eeprom_revid 7:0 0x0 mirroring of rev id loaded from eeprom. default_revid 15:8 0x0 mirroring of default rev id, before eeprom load (0x0 for the 82598 a0). reserved 31:16 0x0 reserved field bit(s) initial value description function number 2:0 0x0 function number function number assigned to the function based on bios/os enumeration. device number 7:3 0x0 device number device number assigned to the function based on bios/os enumeration. bus number 15:8 0x0 bus number bus number assigned to the function based on bios/os enumeration. reserved 31:16 0x0 reserved field bit(s) initial value description dca_dis 0 1b dca disable when 0b, dca tagging is enabled for the 82598. when 1b, dca tagging is disabled for the 82598. dca_mode 4:1 0x0 dca mode when 0000b, platform is fsb. in this case, the tag field in the tlp header is bit 0 (dca enable) and bits 3:1 are cu id. when 0001b, platform is csi. in this case, when dca is disabled for a given message, the tag field is 11111b; if dca is enabled, the tag is set per queue as programmed in the relevant dca control register. other values are undefined. reserved 31:5 0x0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 391 4.4.3.13 mac registers 4.4.3.13.1 pcs_1g global config register 1 ? pcs1gcfig (0x04200, rw) 4.4.3.13.2 pcg_1g link control register ? pcs1glctl (0x04208; rw) field bit(s) initial value description reserved 31 0b reserved pcs_isolate 30 0b pcs isolate setting this bit isolates the 1 gb/s pcs logic from the mac?s data path. pcs control codes are still sent and received. reserved 29:0 0x0 reserved field bit(s) initial value description reserved 31:26 0x0 reserved reserved 25 1b reserved reserved 24:21 0x0 reserved reserved 20 0b reserved ? must be set to 0b. reserved 19 0b reserved an 1g timeout en 18 1b auto negotiation1 gb/s timeout enable this bit enables the 1 gb/s auto negotiation timeout feature. during 1 gb/s auto negotiation if the link partner doesn?t respond with auto negotiation pages but continues to send good idle symbols then link up is assumed. (this enables a link-up condition when a link partner is not auto-negotiation capable and does not affect otherwise). an 1g restart 17 0b auto negotiation 1 gb/s restart setting this bit restarts the clause 37 1 gb/s auto negotiation process. this bit is self clearing. reserved 16 0b reserved reserved 15:7 0x0 reserved link latch low 6 0b link latch low enable if this bit is set then link ok going low (negedge) is latched till cpu read happens. once cpu read happens, link ok is continuously updated until link ok again goes low (negedge is seen). force 1g link 5 0b force 1 gb/s link if this bit is set then internal link_ok variable is forced to forced link value , bit 0 of this register. else link_ok is decided by internal an/sync state machines. this bit is only valid when the link mode is 1 gb/s.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 392 october 2010 4.4.3.13.3 pcs_1g link status register ? pcs1glsta (0x0420c; ro) reserved 4:1 0x0 reserved flv 0 0b forced link 1 gb/s value this bit denotes the link condition when force link is set. 0b = forced link down. 1b = forced 1 gb/s link up. field bit(s) initial value description reserved 31:21 0x0 reserved. an error (rw) 20 0b auto negotiation error this bit indicates that an auto negotiation error condition was detected in 1 gb/s auto negotiation mode. valid after the an 1g complete bit is set. auto negotiation error conditions: ? both node not full duplex or remote fault indicated or received. ? software can also force an auto negotiation error condition by writing to this bit (or can clear a existing auto negotiation error condition). cleared at the start of auto negotiation. reserved 19 0b reserved an 1g timedout 18 0b auto negotiation1 gb/s timed out this bit indicates 1 gb/s auto negotiation process was timed out. valid after an 1g complete bit is set. reserved 17 0b reserved an 1g complete 16 0b auto negotiation1 gb/s complete this bit indicates that the 1 gb/s auto negotiation process has completed. reserved 15:5 0x0 reserved. sync ok 1g 4 0b sync ok 1 gb/s this bit indicates the current value of syn ok from the 1 gb/s pcs sync state machine. reserved 3:1 111b reserved link_ok_1g 0 0b link ok 1 gb/s this bit denotes the current 1 gb/s link ok status. 0b = 1 gb/s link down. 1b = 1 gb/s link up/ok.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 393 4.4.3.13.4 pcs_1 gb/s auto negotiation advanced register pcs1gana (0x04218; rw) 4.4.3.13.5 pcs_1gan lp ability register ? pcs1ganlp (0x0421c; ro) field bit(s) initial value description reserved 31:16 0x0 reserved nextp 15 0b next page capable the 82598 asserts this bit to request next page transmission. clear this bit when the 82598 has no subsequent next pages. reserved 14 0b reserved rflt 13:12 00b remote fault the 82598's remote fault condition is encoded in this field. the 82598 might indicate a fault by setting a non-zero remote fault encoding and re-negotiating. 00b = no error, link ok. 01b = link failure. 10b = offline. 11b = auto negotiation error. reserved 11:9 0x0 reserved asm 8:7 11b asm_dir/pause - local pause capabilities the 82598's pause capability is encoded in this field. 00b = no pause. 01b = symmetric pause. 10b = asymmetric pause toward link partner. 11b = both symmetric and asymmetric pause toward the 82598. reserved 6 0b reserved fdc 5 1b fd ? full-duplex setting this bit indicates that the 82598 is capable of full- duplex operation. this bit should be set to 1b for normal operation. reserved 4:0 0x0 reserved field bit(s) initial value description reserved 31:16 0x0 reserved lpnextp 15 0b lp next page capable (serdes) the link partner asserts this bit to indicate its ability to accept next pages. ack 14 0b acknowledge (serdes) the link partner has acknowledge page reception.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 394 october 2010 4.4.3.13.6 pcs_1g auto negotiation next page transmit register ? pcs1gannp (0x04220; rw) prf 13:12 00b lp remote fault (serdes)[13:12] the link partner's remote fault condition is encoded in this field. 00b = no error, link ok. 10b = link failure. 01b = offline. 11b = auto negotiation error. reserved 11:9 0x0 reserved lpasm 8:7 00b lpasmdr/lppause(serdes) the link partner's pause capability is encoded in this field. 00b = no pause. 01b = symmetric pause. 10b = asymmetric pause toward link partner. 11b = both symmetric and asymmetric pause toward the 82598. lphd 6 0b lp half-duplex (serdes) when 1b, link partner is capable of half duplex operation. when 0b, link partner is incapable of half duplex mode. lpfd 5 0b lp full-duplex (serdes) when 1b, link partner is capable of full duplex operation. when 0b, link partner is incapable of full duplex mode. reserved 4:0 0x0 reserved field bit(s) initial value description reserved 31:16 0x0 reserved nxtpg 15 0b next page this bit is used to indicate whether or not this is the last next page to be transmitted. the encodings are: 0b = last page. 1b = additional next pages follow. reserved 14 0b reserved pgtype 13 0b message/ unformatted page this bit is used to differentiate a message page from an unformatted page. the encodings are: 0b = unformatted page. 1b = message page. ack2 12 0b acknowledge2 acknowledge is used to indicate that the 82598 has successfully received its link partners' link code word.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 395 4.4.3.13.7 pcs_1g auto negotiation lp's next page register ? pcs1ganlpnp (0x04224; ro) toggle 11 0b toggle this bit is used to ensure synchronization with the link partner during next page exchange. this bit always takes the opposite value of the toggle bit in the previously exchanged link code word. the initial value of the toggle bit in the first next page transmitted is the inverse of bit 11 in the base link code word and therefore might assume a value of 0b or 1b. the toggle bit is set as follows: 0b = previous value of the transmitted link code word equaled 1b. 1b = previous value of the transmitted link code word equaled 0b. code 10:0 0x0 message/unformatted code field the message field is a 11-bit wide field that encodes 2048 possible messages. unformatted code field is a 11-bit wide field that might contain an arbitrary value. field bit(s) initial value description reserved 31:16 0x0 reserved nxtpg 15 0b next page this bit is used to indicate whether or not this is the last next page to be transmitted. the encodings are: 0b = last page. 1b = additional next pages follow. ack 14 0b acknowledge the link partner has acknowledge next page reception. msgpg 13 0b message page this bit is used to differentiate a message page from an unformatted page. the encodings are: 0b = unformatted page. 1b = message page. ack2 12 0b acknowledge acknowledge is used to indicate that the 82598 has successfully received its link partners' link code word. toggle 11 0b toggle this bit is used to ensure synchronization with the link partner during next page exchange. this bit always takes the opposite value of the toggle bit in the previously exchanged link code word. the initial value of the toggle bit in the first next page transmitted is the inverse of bit 11 in the base link code word and therefore might assume a value of 0b or 1b. the toggle bit is set as follows: 0b = previous value of the transmitted link code word equaled 1b. 1b = previous value of the transmitted link code word equaled 0b. code 10:0 0x0 message/unformatted code field the message field is a 11-bit wide field that encodes 2048 possible messages. unformatted code field is a 11-bit wide field that might contain an arbitrary value.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 396 october 2010 4.4.3.13.8 flow control 0 register ? hlreg0 (0x04240, rw) field bit(s) initial value description txcrcen 0 1b tx crc enable enables a crc to be appended to a tx packet if requested. 1b = enable crc. 0b = no crc appended, packets always passed unchanged. this bit must be set to 1b if the 82598 is enabled to send flow control frames. rxcrcstrp 1 1b rx crc strip causes the crc to be stripped from all packets 1b = strip crc. 0b = no crc. jumboen 2 0b jumbo frame enable allows frames up to the size specified in the mhadd (31:16) register. 1b = enable jumbo frames. 0b = disable jumbo frames. reserved 9:3 1111111b reserved and must be set to 1111111b. txpaden 10 1b tx pad frame enable pad short tx frames to 64 bytes if requested. 1b = pad frames. 0b = transmit short frames with no padding. reserved 11 1b reserved must be set to 1b. reserved 12 0b reserved this bit should not be set to 1b. reserved 13 1b reserved reserved 14 0b reserved this bit should not be set to 1b. lpbk 15 0b loopback turn on loopback where transmit data is sent back through the receiver. to activate loopback the link should be active or autoc.flu should be set. 1b = loopback enabled. 0b = loopback disabled. mdcspd 16 0b mdc speed high or low speed mdc to pcs, xgxs, wis, etc. when at 10 gb/s: 1b = 24 mhz. 0b = 2.4 mhz. when at 1gb/s: 1b = 2.4 mhz. 0b = 240 khz.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 397 4.4.3.13.9 flow control status 1 register- hlreg1 (0x04244, ro) field bit(s) initial value description contmdc 17 0b continuous mdc turn off mdc between mdio packets 1b = continuous mdc. 0b = mdc off between packets. reserved 18 0b reserved this bit should not be set to 1b. reserved 19 0b reserved prepend 23:20 0x0 prepend value number of 32-bit words, starting after the preamble and sfd, to exclude from the crc generator and checker. reserved 24 0x0 reserved reserved 26:25 00b reserved rxlngtherren 27 1b rx length error reporting: 1b = enable reporting of rx_length_err events if length field <0x0600. 0b = disable reporting of all rx_length_err events. reserved 28 0b reserved reserved 31:29 0x0 reserved field bit(s) initial value description revid 3:0 0001b rev id version number of the mac core. current version (release 1.6) = 0001b. autoscan 4 0b autoscan in progress autoscan enabled and cleared after completion. 1b = autoscan in progress. 0b = autoscan idle (default). rxerrsym 5 0b rx error symbol error symbol during rx packet (latch high; clear on read). 1b = error symbol received. 0b = no error symbol. rxillsym 6 0b rx illegal symbol illegal symbol during rx packet (latch high; clear on read). 1b = illegal symbol received. 0b = no illegal symbol received.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 398 october 2010 4.4.3.13.10 pause and pace register ? pap (0x04248, rw) field bit(s) initial value description rxidlerr 7 0b rx idle error non idle symbol during idle period (latch high; clear on read). 1b = idle error received. 0b = no idle errors received. rxlclflt 8 0b rx local fault fault reported from pmd, pma, or pcs (latch high; clear on read). 1b = local fault is or was active. 0b = no local fault. rxrmtflt 9 0b rx remote fault link partner reported remote fault (latch high; clear on read). 1b = remote fault is or was active. 0b = no remote fault. reserved 31:10 0x0 reserved field bit(s) initial value description reservedtxpause cnt 15:0 0xffff reserved tx pause count : pause count value in pause quanta (a time slot of 512 bit times) included in the tx pause frame used to pause link partner's transmitter (default = ffff hex) pace 19:16 0000b 0000b = 10 gb/s (lan). 0001b = 1 gb/s. 0010b = 2 gb/s. 0011b = 3 gb/s. 0100b = 4 gb/s. 0101b = 5 gb/s. 0110b = 6 gb/s. 0111b = 7 gb/s. 1000b = 8 gb/s. 1001b = 9 gb/s. 1111b = 9.294196 gb/s (wan). reserved 31:20 0x0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 399 4.4.3.13.11 mdi auto-scan command and address ? maca (0x0424c; rw) 4.4.3.13.12 auto-scan phy address enable ? apae (0x04250; rw) 4.4.3.13.13 auto-scan read data ? ard (0x04254; rw) field bit(s) initial value description atscnadd 15:0 0000b auto-scan address address used for indirect address management frame format. regbitsel 19:16 0000b register bit select select one of 16 data bits to latch from the register. devadd 24:20 00000b device type/register address five bits representing either the device type with st = 00b or the register address with st = 01b. stcode 26:25 01b st code two bits identifying start of frame and old or new protocol. 00b = new protocol. 01b = old protocol. 1xb = illegal. atscanen 27 0b auto-scan enable enable repetitive auto-scan function. 1b = autoscan enable. 0b = autoscan disable. atscaninten 28 0b auto-scan interrupt enable enable auto-scan interrupt generation. 1b = autoscan interrupt enable. 0b = autoscan interrupt disable. atscanintlvl 29 1b auto-scan interrupt level active level for the auto-scan interrupt. 1b = auto-scan interrupt active high. 0b = auto-scan interrupt active low. reserved 31:30 00b reserved field bit(s) initial value description atscanphyadden 31:0 00b auto-scan phy address enable bit to enable corresponding phy address. 01b = enable this address. 00b = disable this address field bit(s) initial value description rddata 31:0 0x0 read data data from the selected register bit in the corresponding phy.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 400 october 2010 4.4.3.13.14 auto-scan interrupt status ? ais (0x04258; rw) 4.4.3.13.15 mdi single command and address ? msca (0x0425c; rw) field bit(s) initial value description intsta 31:0 0x0 interrupt status selected bit changed in corresponding phy (latch high, clear on read). 0x1 = data changed in corresponding phy. 0x0 = no change in data from corresponding phy. register is latched high and cleared on read. field bit(s) initial value description mdiadd 15:0 0x0000 mdi address address used for new protocol mdi accesses (default = 0x0000). devadd 20:16 0x0 device type/reg address five bits representing to either the device type with st = 00b or the register address with st = 01b. phyadd 25:21 0x0 phy address the address of the external device. opcode 27:26 00b op code two bits identifying operation to be performed (default = 00b). 00b = address cycle (new protocol only). 01b = write operation. 10b = read operation. 11b = read, increment address (new protocol only). stcode 29:28 01b st code two bits identifying start of frame and old or new protocol (default = 01b). 00b = new protocol. 01b = old protocol. 1x = illegal. mdicmd 30 0b mdi command perform the mdi operation in this register; cleared when done. 1b = perform operation; operation in progress. 0b = mdi ready; operation complete (default). mdiinprogen 31 0b mdi in progress enable generate mdi in progress when operation completes. 1b = mdi in progress enabled. 0b = mdi ready disable (default).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 401 4.4.3.13.16 mdi single read and write data ? msrwd (0x04260; rw) 4.4.3.13.17 low mac address ? mladd (0x04264; rw) 4.4.3.13.18 mac address high and max frame size ? mhadd (0x04268; rw) 4.4.3.13.19 xgxs status 1 ? pcss1 (0x4288; ro) field bit(s) initial value description mdiwrdata 15:0 0x0000 mdi write data write data for mdi writes to the external device. mdirddata 31:16 0x0000 mdi read data read data from the external device (ro). field bit(s) initial value description macl 31:0 0x0 mac adress [31:0] least significant 32 bits of the mac address field bit(s) initial value description reservedmach 15:0 0x0 reserved mac adress [47:32] most significant 16 bits of the mac address mfs 31:16 0x5ee max frame size maximum number of bytes in a frame that can be transmitted. sets the boundary between oversize and jumbo frames on receive when jumbo frames are enabled. the value includes the crc. note: for the receive side, if the packet has a vlan field then the value of the mfs is internally increased by four bytes. note: for the transmit side, enforcing the max frame size restriction should be done by software (the 82598 does not limit the transmit packet size). field bit(s) initial value description reserved 31:8 0x0 reserved local fault 7 1b 1b = lf detected on transmit or receive path. the lf bit is set to 1b when either of the local fault bits located in pcs status 2 register are set to 1b. 0b = no lf detected on receive path. reserved 6:3 0x0 reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 402 october 2010 4.4.3.13.20 xgxs status 2 ? pcss2 (0x0428c; ro) 4.4.3.13.21 10gbase-x pcs status ? xpcss (0x04290; ro) pcs receive link status 20b 1b = pcs receive link up. for 10base-x ->lanes de-skewed. 0b = pcs receive link down. the receive link status remains cleared until it is read (latching low). reserved 1:0 00b reserved field bit(s) initial value description reserved 31:16 0x0 reserved device present 15:14 10b 10b = 82598 responding at this address. 11b, 01b, 00b = no 82598 responding at this address. reserved 13:12 00b reserved transmit local fault 11 0b 1b = local fault condition on the transmit path. 0b = no local fault condition on the transmit path (latch high). receive local fault 10 1b 1b = local fault condition on the receive path. 0b = no local fault condition on the receive path (latch high). reserved 9:3 0x0 reserved 10gbase-w capable 20b 1b = pcs is able to support 10gbase-w port type. 0b = pcs is not able to support 10gbase-w port type. 10gbase-x capable 11b 1b = pcs is able to support 10gbase-x port type. 0b = pcs is not able to support 10gbase-x port type. 10gbase-r capable 00b 1b = pcs is able to support 10gbase-r port type. 0b = pcs is not able to support 10gbase-r port type. field bit(s) initial value description reserved 31:30 00b reserved lane 3 signal detect 29 0b 1b = indicates a signal is detected. 0b = indicates noise, no signal is detected. lane 2 signal detect 28 0b 1b = indicates a signal is detected. 0b = indicates noise, no signal is detected. lane 1 signal detect 27 0b 1b = indicates a signal is detected. 0b = indicates noise, no signal is detected. lane 0 signal detect 26 0b 1b = indicates a signal is detected. 0b = indicates noise, no signal is detected.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 403 lane 3 comma count 4 25 0b 1b = indicates the comma count for that lane has reached four. 0b = indicates the comma count for that lane is less than four (latch high). lane 2 comma count 4 24 0b 1b = indicates the comma count for that lane has reached four. 0b = indicates the comma count for that lane is less than four (latch high). lane 1 comma count 4 23 0b 1b = indicates the comma count for that lane has reached four. 0b = indicates the comma count for that lane is less than four (latch high). lane 0 comma count4 22 0b 1b = indicates the comma count for that lane has reached four. 0b = indicates the comma count for that lane is less than four (latch high). lane 3 invalid code 21 0b 1b = indicates an invalid code was detected for that lane. 0b = indicates no invalid code was detected (latch high). lane 2 invalid code 20 0b 1b = indicates an invalid code was detected for that lane 0b = indicates no invalid code was detected (latch high). lane 1 invalid code 19 0b 1b = indicates an invalid code was detected for that lane. 0b = indicates no invalid code was detected (latch high). lane 0 invalid code 18 0b 1b = indicates an invalid code was detected for that lane. 0b = indicates no invalid code was detected (latch high). align column count 4 17 0b 1b = indicates the align column count has reached four. 0b = indicates the align column count is less than four (latch high). de-skew error 16 0b 1b = indicates a de-skew error was detected. 0b = indicates no de-skew error was detected (latch high). reserved 15:13 0x0 reserved, ignore when read. 10gbase-x lane alignment status 12 0b 1b = 10gbase-x pcs receive lanes aligned (align_status = ok). 0b = 10gbase-x pcs receive lanes not aligned. reserved 11: 4 0x0 ignore when read. lane 3 sync 3 0b 1b = lane 3 is synchronized. 0b = lane 3 is not synchronized. lane 2 sync 2 0b 1b = lane 2 is synchronized. 0b = lane 2 is not synchronized. field bit(s) initial value description lane 1 sync 1 0b 1b = lane 1 is synchronized. 0b = lane 1 is not synchronized. lane 0 sync 0 0b 1b = lane 0 is synchronized. 0b = lane 0 is not synchronized.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 404 october 2010 4.4.3.13.22 serdes interface control register ? serdesc (0x04298; rw) field bit(s) initial value description swap_rx_lane_0 31:30 00b 1 determines which core lane is mapped to mac rx lane 0 00b = core rx lane 0 to mac rx lane 0. 01b = core rx lane 1 to mac rx lane 0. 10b = core rx lane 2 to mac rx lane 0. 11b = core rx lane 3 to mac rx lane 0. swap_rx_lane_1 29:28 01b 1 determines which core lane is mapped to mac rx lane 1. swap_rx_lane_2 27:26 10b 1 determines which core lane is mapped to mac rx lane 2. swap_rx_lane_3 25:24 11b 1 determines which core lane is mapped to mac rx lane 3. swap_tx_lane_0 23:22 00b 1 determines the core destination tx lane for mac tx lane 0 00b = mac tx lane 0 to core tx lane 0. 01b = mac tx lane 0 to core tx lane 1. 10b = mac tx lane 0 to core tx lane 2. 11b = mac tx lane 0 to core tx lane 3. swap_tx_lane_1 21:20 01b 1 determines core destination tx lane for mac tx lane 1. swap_tx_lane_2 19:18 10b 1 determines core destination tx lane for mac tx lane 2. swap_tx_lane_3 17:16 11b 1 determines core destination tx lane for mac tx lane 3. reserved 15:12 0x0 1 reserved software should not change the default eeprom value. reserved 11:8 0x0 1 reserved software should not change the default eeprom value. field bit(s) initial value description
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 405 4.4.3.13.23 fifo status/cntl report register ? macs (0x0429c; rw) this register reports fifo status in xgmii_mux. 4.4.3.13.24 auto negotiation control register ? autoc (0x042a0; rw) rx_lanes_polarity 7:4 0x0 1 bit 7 ? changes bits polarity of mac rx lane 3 bit 6 ? changes bits polarity of mac rx lane 2 bit 5 ? changes bits polarity of mac rx lane 1 bit 4 ? changes bits polarity of mac rx lane 0 changes bits polarity if set to 0x1 tx_lanes_polarity 3:0 0x0 1 bit 3 ? changes bits polarity of mac tx lane 3. bit 2 ? changes bits polarity of mac tx lane 2. bit 1 ? changes bits polarity of mac tx lane 1. bit 0 ? changes bits polarity of mac tx lane 0. changes bits polarity if set to 0x1. 1. loaded from the eeprom. field bit(s) initial value description rx fifo overrun 31 0b indicates fifo overrun in xgmii_mux_rx_fifo. rx fifo underrun 30 0b indicates fifo underrun in xgmii_mux_rx_fifo. tx fifo overrun 29 0b indicates fifo overrun in xgmii_mux_tx_fifo. tx fifo underrun 28 0b indicates fifo underrun in xgmii_mux_tx_fifo. config fifo threshold 27:24 0x6 determines threshold for asynchronous fifo (generation of data_available signal is determined by cfg_fifo_th[3:0]). reserved 23:16 0x7 reserved reserved 15:4 0x0 reserved reserved 3 0b reserved reserved 2 0b reserved reserved 1 0b reserved reserved 0 0b reserved field bit(s) initial value description kx_support 31:30 11b 1 the value shown in bits a0:a1 of the technology ability field of the auto negotiation word. 00b: illegal value. 01b: a0 = 1 a1 = 0. kx supported. kx4 not supported. 10b: a0 = 0 a1 = 1. kx not supported. kx4 supported. 11b: a0 = 1 a1 = 1. kx supported. kx4 supported.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 406 october 2010 pb 29:28 00b 1 pause bits the value of these bits is loaded to bits d11-d10 of the link code word (pause data). bit 29 is loaded to d11. rf 27 0b 1 this bit is loaded to the rf of the auto negotiation word. anpdt 26:25 00b 1 auto negotiation parallel detect timer configure the parallel detect counters. 00b = 1 ms. 01b = 2 ms. 10b = 5 ms 11b = 8 ms. reserved 24 1b 1 reserved must be set to 0b for normal operation. anrxdm 23 1b 1 auto negotiation rx drift mode enable following the drift caused by ppm in the rx data. 0b = disable drift mode. 1b = enable drift mode. anrxat 22:18 0x3 1 auto negotiation rx align threshold set threshold to determine alignment is stable. reserved 17:16 00b 1 reserved lms 15:13 001b 1 link mode select selects the active link mode: 000b = 1 gb/s link (no auto negotiation). 001b = 10 gb/s link (no auto negotiation). 010b = 1 gb/s link with clause 37 auto negotiation enable. 011b = reserved. 100b = kx4/kx auto negotiation disable. 1 gb/s (clause 37) auto negotiation disable. 101b = reserved. 110b = kx4/kx auto negotiation enable. 1 gb/s (clause 37) auto negotiation enable. 111b = reserved. restart_an 12 0b 1 restart kx/kx4 auto negotiation process (self-clearing bit) 0b = no action needed. 1b = restart kx/kx4 auto negotiation. field bit(s) initial value description ratd 11 0b 1 restart auto negotiation on transition to dx this bit enables the functionality to restart kx/kx4 auto negotiation transition to dx(dr/d3). 0b = do not restart auto negotiation when the 82598 moves to the dx state. 1b = restart auto negotiation to reach a low-power link mode (1 gb/s link) when the 82598 transitions to the dx state.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 407 4.4.3.13.25 link status register ? links (0x042a4; ro) d10gmp 10 0b 1 disable 10 gb/s (kx4) on dx(dr/d3) without main power. 0b = no specific action. 1b = disable 10 gb/s when main power is removed. when ratd bit is also set to 1b, it causes the link mode to disable 10 gb/s capabilities and restart auto negotiation (if enabled) when the main-power (main_pwr_ok) is removed. 1g_pma_pmd 9 1b 1 pma/pmd used for 1 gb/s. 0b = bx pma/pmd. 1b = kx pma/pmd. 10g_pma_pmd 8:7 10b 1 pma/pmd used for 10 gb/s. 00b = xaui pma/pmd. 01b = kx4 pma/pmd. 10b = cx4 pma/pmd. 11b = reserved. ansf 6:2 00001b 1 an selector this value is used as the selector field in the link control word during the clause 73 auto-negotiation process. note that the default value is according to 802.3ap draft 2.4 specification. anack2 1 0b 1 an ack2 this value is transmitted in the acknowledge2 field of the null next page that is transmitted during a next page handshake. flu 0 0b force link up this setting forces the auto-negotiation arbitration state machine to an_good and sets the link-up indication regardless of the xgxs/ pcs_1g status. 0b = normal mode. 1b = mac forced to link up. link is active in the speed configured in autoc.lms. 1. loaded from the eeprom. field bit(s) initial value description kx/kx4 an completed 31 0b indicate kx/kx4 auto negotiation has completed successfully. link up 30 0b link up. 1b = link is up. 0b = link is down. link speed 29 1b speed of the mac link. 1b = 10 gb/s link speed. 0b = 1 gb/s link speed. reserved 28:27 01b reserved reserved 26:25 01b reserved reserved 24:23 01b reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 408 october 2010 4.4.3.13.26 auto negotiation control 2 register ? autoc2 (0x042a8; rw) 10g link enabled (xgxs) 22 0b xgxs enabled for 10 gb/s operation. 1g link enabled pcs_1g 21 0b pcs_1g enabled for 1 gb/s operation. 1g an enabled (clause 37 an) 20 0b pcs_1 gb/s auto negotiation is enabled (clause 37). kx/kx4 an receiver idle 19 0b kx/kx4 auto negotiation rx idle 0b = receiver is operational. 1b = receiver is in idle- waiting to align and sync on dme. 1g sync status 18 1b 1g sync_status 0b = sync_status is not synchronized to code-group. 1b = sync_status is synchronized to code-group. 10g align status 17 1b 10 gb/s align_status 0b = align_status is not operational (deskew process not complete). 1b = align_status is operation (all lanes are synchronized and aligned). 10g lane sync_status 16:13 1b 10 gb/s sync_status of the lanes. bit[16,15,14,13] show lane <3,2,1,0> status accordingly. per each bit: 0b = sync_status is not synchronized to code-group. 1b = sync_status is synchronized to code-group. transmit local fault 12 1b xgxs local fault sequences transmission 0b = lf is not transmitted. 1b = lf is now transmitted. signal detect 11:8 0x0 signal detection bit[11, 10, 9, 8] show lane <3,2,1,0> status accordingly per each bit: 0b = a signal is not present. 1b = a signal is present. link status check 7 0b 1b = link is up and there was no link down from last time read. 0b = link is/was down. latched low upon link down. self-cleared upon read. field bit(s) initial value description kx/kx4 an page received 6 0b kx/kx4 auto negotiation page received a new link partner page was received during auto negotiation process. latch high; clear on read. kx/kx4 an next page received 5 0x0 kx/kx4 auto negotiation next page received a new link partner next page was received during an auto-negotiation process. reserved 4:0 0x0 reserved field bit(s) initial value description reserved 31 0b reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 409 4.4.3.13.27 auto negotiation control 3 register ? autoc3 (0x042ac; rw) 4.4.3.13.28 auto negotiation link partner link control word 1 register ? anlp1 (0x042b0; ro) pdd 30 0b 1 disable the parallel detect part in the kx/kx4 auto negotiation. when set to 1b, the auto negotiation process avoids any parallel detect activity and relies only on the dme pages receive and transmit. 1b = reserved. 0b = enable the parallel detect (normal operation). reserved 29:28 00b 1 reserved reserved 27:24 0000b 1 reserved lh1gai 23 0b 1 latch high 10 gb/s aligned indication override any de-skew alignment failures in the 10 gb/s link (by latching high). this keeps the link up after first time it reached the an_good state in 10 gb/s (unless restartan is set). reserved 21:20 00b reserved reserved 19:16 0x0 reserved an page d low override 15:0 0x0 set auto-negotiation advertisement page fields d[15:0] used when auto2.an_advertsement_page_override is set. bits: 15 = np. 14 = acknowledge. 13 = rf. 12:10 = pause c[2:0]. 9:5 = echoed nonce field. 4:0 = selector field. 1. loaded from the eeprom. field bit(s) initial value description technology ability field high override 31:16 0x0 set auto negotiation advertisement page fields a[26:11]. used when autoc2.an_advertisement_page_override is set. technology ability field low override 15:5 0x0 set auto negotiation advertisement page fields a[10:0]. used when autoc2.an_advertisement_page_override is set. note: autoc/kx_support value must be aligned with bits [6:5] that represent a[1:0] in the override values. transmitted nonce field override 4:0 0x0 set auto negotiation advertisement page fields t[4:0]. used when autoc2.an_advertisement_page_override is set. field bit(s) initial value description
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 410 october 2010 to ensure software?s ability to read the same link partner link control word (located across two registers), once anlp1 is read the anlp2 register is locked until the anlp2 register is read. anlp2 does not hold valid data before anlp1 is read. 4.4.3.13.29 auto negotiation link partner link control word 2 register ? anlp2 (0x042b4; ro) to ensure software?s ability to read the same link partner link control word (located across two registers), once anlp1 is read the anlp2 register is locked until the anlp2 register is read. anlp2 does not hold valid data before anlp1 is read. 4.4.3.13.30 mac manageability control register ? mmngc (0x042d0; host-ro/mng-rw) reserved 31:20 0x0 reserved reserved 19:16 0x0 reserved lp an page d low 15:0 0x0 link partner (lp) auto negotiation advertisement page fields d[15:0]. [15] = np. [14] = acknowledge. [13] = rf. [12:10] = pause c[2:0]. [9:5] = echoed nonce field. [4:0] = selector field. field bit(s) initial value description lp technology ability field high 31:16 0x0 lp auto negotiation advertisement page fields a[26:11]. lp technology ability field low 15:5 0x0 lp auto negotiation advertisement page fields a[10:0]. lp transmitted nonce field 4:0 0x0 lp auto negotiation advertisement page fields t[4:0]. field bit(s) initial value description reserved 31:1 0x0 reserved mng_veto 0 0b mng_veto (default 0) access read/write by manageability, read only to the host. 0b = no specific constraints on link from manageability. 1b = hold off any low-power link mode changes. this is done to avoid link loss and interrupting manageability activity.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 411 4.4.3.13.31 auto negotiation link partner next page 1 register ? anlpnp1 (0x042d4; ro) to ensure software?s ability to read the same link partner next page (located across 2 registers), once anlpnp1 is read the anlpnp2 register is locked until the anlpnp2 register is read. anlpnp2 does not hold valid data before anlpnp1 is read. 4.4.3.13.32 auto negotiation link partner next page 2 register ? anlpnp2 (0x042d8; ro) to ensure software?s ability to read the same link partner link control word (located across 2 registers), once anlpnp1 is read the anlpnp2 register is locked until the anlpnp2 register is read. anlpnp2 does not hold valid data before anlpnp1 is read. 4.4.3.13.33 core analog configuration register - atlasctl (0x04800; rw) reading the core registers must be done using the following steps: 1. send a write command with bit 16 set, and the desired reading offset in the address field (bits [15:8]). 2. send a read command to the atlasctl. the returned data is from the indirect address in the core register space which was provided in step (1). field bit(s) initial value description lp an next page low 31:0 0x0 lp an next page fields d[31:0] [31:16] = unformatted code. [15] = np. [14] = acknowledge. [13] = mp. [12] = acknowledge2. [11] = toggle. [10:0] = message/unformatted code. field bit(s) initial value description reserved 31:16 0x0 reserved lp an next page high 15:0 0x0 lp an next page fields d[47:32]. [15:0] = unformatted code. field bit(s) initial value description reserved 31:17 0b reserved latch address 16 0b 0b = normal write operation. 1b = latch this address for next read transaction. the data is ignored and is not written on this transaction. address 15:8 0b address to core analog registers data 7:0 0b data to core analog registers. data is ignored when bit 16 is set
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 412 october 2010 to configure (write) registers in the core block the driver should write the proper address to the atlasctl.address and the data to be written to the atlasctl.data.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 413 5. system manageability network management is an increasingly important requirement in today's networked computer environment. software-based management applications provide the ability to administer systems while the operating system is functioning in a normal power state (not in a pre-boot state or powered-down state). the intel? system management bus (smbus) interface and the network controller - sideband interface (nc-si) for the 82598 fills the management void that exists when the operating system is not running or fully functional. this is accomplished by providing a mechanism by which manageability network traffic can be routed to and from a management controller. the 82598 provides two different and mutually exclusive bus interfaces for manageability traffic. the first is the intel proprietary smbus interface; several generations of intel? ethernet controllers have provided this same interface that operates at speeds of up to 1 mhz. the second interface is nc-si, which is a new industry standard interface created by the dmtf specifically for routing manageability traffic to and from a management controller. the nc-si interface operates at 100 mb/s full-duplex speeds. 5.1 pass-through (pt) functionality pass-through (pt) is the term used when referring to the process of sending and receiving ethernet traffic over the sideband interface. the 82598 has the ability to route ethernet traffic to the host operating system as well as the ability to send ethernet traffic over the sideband interface to an external bmc.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 414 october 2010 figure 5-1. sideband interface the sideband interface provides a mechanism by which the 82598 can be shared between the host and the bmc. by providing this sideband interface, the bmc can communicate with the lan without requiring a dedicated ethernet controller to do so. the 82598 eternet controller supports two sideband interfaces: ? smbus ?nc-si the usable bandwidth for either direction is up to 400 kb/s when using the smbus interface and 100 mb/s for the nc-si interface. note that only one mode of sideband can be active at any given time. this configuration is done via an eeprom setting. 5.2 components of a sideband interface there are two components to a sideband interface: ? physical layer - the electrical layer that transfers data ? logical layer - the agreed upon protocol that is used for communications the bmc and the 82598 must be in alignment for both of these components. for example, the nc-si physical interface is based on the rmii interface. however, there are some differences at the physical level (detailed in the nc-si specification) and the protocol layer is completely different.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 415 5.3 smbus pass-through interface smbus is the system management bus defined by intel? corporation in 1995. it is used in personal computers and servers for low-speed system management communications. the smbus interface is one of two pass-through interfaces available in the 82598 controller. this section describes how the smbus interface in the 82598 operates in pass-through mode. 5.3.1 general the smbus sideband interface includes the standard smbus commands used for assigning a slave address and gathering device information as well as intel proprietary commands used specifically for the pass-through interface. 5.3.2 pass-through capabilities this section details the specific manageability capabilities the 82598 provides while in smbus mode. the pass-through traffic is carried by the sideband interface as described in section 5.1 . when operating in smbus mode, in addition to exposing a communication channel to the lan for the bmc, the 82598 provides the following manageability services to the bmc: ? arp handling - the 82598 can be programmed to auto-arp replying for arp request packets to reduce the traffic over the bmc interconnect. see section 5.3.3.2 for details. ? teaming and fail-over - the 82598 can be configured to one of several teaming and fail-over configurations (see section 5.3.11.1 ): ? no-teaming - the 82598 dual lan ports act independently of each other and no fail-over is provided by the 82598. the bmc is responsible for teaming and fail-over. ? teaming - the 82598 is configured to provide fail-over capabilities, such that manageability traffic is routed to an active port if any of the ports fail. several modes of operation are provided. note: these services are not available in nc-si mode. 5.3.2.1 packet filtering since the host os and the bmc both use the 82598 ethernet controller to send and receive ethernet traffic, there needs to be a mechanism by which incoming ethernet packets can be identified as those that should be sent to the bmc rather than the host os. in order to determine the types of traffic that is forwarded to the bmc over the sideband interface, the 82598 supports a manageability receive filtering mechanism. this mechanism is used to decide if a received packet should be forwarded to the bmc or to the host. the following is a list of the filtering capabilities available for the smbus interface with the 82598: ? rmcp/rmcp+ ports ? flexible udp/tcp port filters ? 128-byte flexible filters ? vlan ? ipv4 address
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 416 october 2010 ? ipv6 address ? mac address filters each of these are discussed in detail later in this section. 5.3.3 pass-through multi-port modes pass-through configuration depends on the way the lan ports are configured. if the lan ports are configured as two different channels (non-teaming mode), then the 82598 is presented on the manageability link as two different devices. for example, via two different smb addresses on which each device is connected to a different lan port. in this mode (the same as in the lan channels), there is no logical connection between the two devices. in this mode the fail-over between the two lan ports is done by the external bmc (by sending/receiving packets through different devices). the status report to the bmc, arp handling, dhcp, and other pass-through functionality are unique for each port. when the lan ports are configured to work as one lan channel (teaming mode), the 82598 presents itself on the smbus as one device (one smb address). in this mode, the external bmc is not aware that there are two lan ports. the 82598 decides how to route the packet that it receives from the lan according to the fail-over algorithm. the status report to the bmc and other pass-through configuration are common to both ports. 5.3.3.1 automatic ethernet arp operation automatic ethernet arp parameters are loaded from the eeprom when the 82598 is powered up or configured through the sideband management interface. the following parameters should be configured in order to enable arp operation: ? arp auto-reply enabled ? arp ip address (to filter arp packets) ? arp mac addresses (for arp responses) these are all configurable over the sideband interface using the advanced version of the receive enable command (see section 5.3.10.1.3 ) or using the eeprom. when an arp request packet is received on the wire, and arp auto-reply is enabled, the 82598 checks the targeted ip address (after the packet has passed l2 checks and arp checks). if the targeted ip matches the ip the 82598 was configured to, than it replies with an arp response. the 82598 responds to arp request targeted to the arp ip address with the arp mac address configured to it. in case that there is no match, the 82598 silently discards the packets. if the 82598 is not configured to do auto- arp response it forwards the arp packets to the bmc. when the external bmc uses the same ip and mac address of the os, the arp operation should be coordinated with the os operation. in this mode, this is the external bmc?s responsibility and the 82598 stops/starts doing automatic arp response as configured. 5.3.3.2 manageability receive filtering this section describes the manageability receive packet filtering flow when in smbus mode. the description applies to a capability of each of the 82598 lan ports. packets that are received by the 82598 can be discarded, sent to the host memory, sent to the external bmc, or sent to both bmc and host memory. 5.3.3.2.1 overview and general structure there are two modes of receive manageability filtering:
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 417 1. receive filtering - in this mode only certain types of packets are directed to the manageability block. the bmc should set the rcv_tco_en bit together with the specific packet type bits in the manageability filtering registers. note: the rcv_all bit must be cleared. 2. receive all - all receive packets are routed to the bmc in this mode. it is enabled by setting the rcv_tco_en bit (which enables packets to be routed to the bmc) and the rcv_all bit (which routes all packets to the bmc) in the manc register. rcv_all is only used for debug because it blocks all host traffic. the default mode is that every packet that is directed to the bmc is not directed to host memory. the bmc enables the 82598 to direct certain manageability packets also to host memory by setting the en_mng2host bit in the manc register. it then needs to configure the 82598 to send manageability packets to the host according to their type by setting the corresponding bits in the manc2h register. the bmc can control the types of packets that it receives by programming the receive manageability filters. following is the list of filters that are accessible to the bmc: all these filters are reset only on internal_power_on_reset. register filters that enable filters or functionality are also reset on fw reset. these registers can be loaded from the eeprom following a reset. the high-level structure of manageability filtering is done in three steps: 1. packets are filtered by l2 criteria (mac address, unicast/multicast/broadcast). 2. packets are then filtered by vlan if a vlan tag is present. 3. packets are filtered by the manageability filters (port, ip, flex, other), as configured in the decision filters. some general rules: ? fragmented packets are passed to manageability but not parsed beyond the ip header. ? packets with l2 errors (crc, alignment, other) are never forwarded to manageability. filters functionality when reset? filters enable general configuration of the manageability filters internal_power_on_reset and fw reset manageability to host enables routing of manageability packets to host internal_power_on_reset and fw reset manageability decision filters [6:0] configuration of manageability decision filters internal_power_on_reset and fw reset mac address [3:0] four unicast mac manageability addresses internal_power_on_reset vlan filters [7:0] eight vlan tag values internal_power_on_reset udp/tcp port filters [15:0] 16 destination port values internal_power_on_reset flexible 128 bytes tco filters [3:0] length values for four flex tco filters internal_power_on_reset ipv4 and ipv6 address filters [3:0] ip address for manageability filtering internal_power_on_reset
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 418 october 2010 note: if the bmc uses a dedicated mac address/vlan tag, it should take care not to use l3/l4 decision filtering on top of it. otherwise all the packets with the manageability mac address/ vlan tag filtered out at l3/l4 are forwarded to the host. the following sections describe each of these stages in detail. 5.3.3.2.2 l2 layer filtering figure 5-2 shows the manageability l2 filtering. a packet passes successfully through l2 filtering if any of the following conditions are met: ? it is a unicast packet and promiscuous unicast filtering is enabled from host. ? it is a multicast packet and promiscuous multicast filtering is enabled from host. ? it is a unicast packet and it matches one of the unicast mac filters (host or manageability). ? it is a multicast packet and it matches one of the multicast filters. ? it is a broadcast packet. note that in this case, the packet does not go through vlan filtering (vlan filtering is assumed to match). promiscuous unicast mode - promiscuous unicast mode can be set/cleared only by the lan device driver (not by the bmc), and it is usually used when the lan device is used as a sniffer. promiscuous multicast mode - promiscuous multicast is used in lan devices that are used as a sniffer, and is controlled only by the lan device driver. this bit can also be used by a bmc requiring forwarding of all multicasts. unicast filtering - the entire mac address is checked against the 16 host unicast addresses and four management unicast addresses (if enabled). the 16 host unicast addresses are controlled by the lan device driver (the bmc can not change them). the other four addresses are dedicated to management functions and are only accessed by the bmc. the bmc configures manageability unicast filtering via update manageability receive filtering (see section 5.3.10.1.6 ). multicast filtering - only 12 bits out of the packet's destination mac address are compared against the multicast entries. these entries can be configured only by the lan device driver and cannot be controlled by the bmc.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 419 figure 5-2. l2 packet filtering (receive) 5.3.3.2.2.1 vlan filtering figure 5-3 shows the manageability vlan filtering. a receive packet that passed l2 layer filtering successfully is then subjected to vlan header filtering: ? if the packet does not have a vlan header and the 82598 is not configured to receive only vlan packets, it passes to the next filtering stage (manageability filtering). ? if the packet has a vlan header and it passes a valid manageability vlan filter and the 82598 is configured to receive vlan packets, it passes to the next filtering stage (manageability filtering). ? if the packet has a vlan header, the 82598 manageability is configured to receive vlan packets, and it matches an enabled host vlan filter, the packet is forwarded to the next filtering stage (manageability filtering). ? otherwise, the packet is dropped. the bmc configures the 82598 with up to eight different manageability vlan ids (vids) via the management vlan tag filters (see section 5.3.3.2.2.1 ).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 420 october 2010 figure 5-3. manageability vlan header filtering (receive) 5.3.3.2.3 manageability decision filtering the manageability decision filtering stage combines some of the checks done at the previous stages with additional l3/l4 checks into a final decision whether to route a packet to the bmc. this section describes the additional filters done at layers l3 &l4, followed by the final filtering rules.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 421 figure 5-4. manageability filtering (receive) 5.3.3.2.3.1 l3 & l4 filters arp filtering the 82598 supports filtering of both arp request packets (initiated externally) and arp responses (to requests initiated by the bmc or the 82598). neighbor discovery filtering the 82598 supports filtering of neighbor discovery packets. neighbor discovery uses the ipv6 destination address filters defined in the mipaf registers (for instance, all enabled ipv6 addresses are matched for neighbor discovery). port 0x298/0x26f filtering
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 422 october 2010 the 82598 supports filtering by fixed destination ports numbers, port 0x26f and port 0x298. flex port filtering the 82598 implements 16 flex destination port filters. the 82598 directs packets that their l4 destination port and matches the value of the respective word in the mfutp registers. the bmc must insure that only valid entries are enabled in the decision filters. flex tco filters the 82598 provides four flex tco filters. each filter looks for a pattern match within the first 128 bytes of the packet. the bmc configures the pattern to match into the ftft table, and the length in the last two entries of the fflt table. the bmc must insure that only valid entries are enabled in the decision filters. ip address filtering the 82598 supports filtering by ip address through ipv4 and ipv6 address filters, dedicated to manageability. two modes are possible, depending on the value of the manc.en_ipv4_filter bit: ? en_ipv4_filter = 0b: the 82598 provides four ipv6 address filters. ? en_ipv4_filter = 1b: the 82598 provides three ipv6 address filters and 4 ipv4 address filters. ? the mfval register indicates which of the ip address filters are valid (for instance, contains a valid entry and should be used for comparison). checksum filter if bit manc.en_xsum_filter is set, the 82598 directs packets to the bmc only if they pass (if exists) l3/l4 checksum, in addition to matching the previously mentioned filters. enabling this filter makes it so the bmc does not need to do the l3/l4 checksum verification, as a packet that fails this filter will never be sent to the bmc. to enable the checksum filter, the bmc uses the update management receive filter parameters command (see section 5.3.10.1.6 ) with the parameter of 0x1 to configure the manc register, setting the en_xsum_filter bit (bit 23). 5.3.3.2.4 manageability decision filters the manageability decision filters are a set of eight filters with the same structure. the filtering rule for each decision filter is programmed by the bmc and defines which of the filters (l2, vlan, manageability) participate in the decision. a packet that passes at least one rule is directed to manageability and possibly to the host. the inputs to each decision filter are: ? packet passed a valid management l2 unicast address filter ? packet is a broadcast packet ? packet has a vlan header and it passed a valid manageability vlan filter ? packet matched one of the valid ipv4 or ipv6 manageability address filters ? packet passed arp filtering (request or response) ? packet passed neighbor discovery filtering ? packet passed 0x298/0x26f port filter ? packet passed a valid flex port filter ? packet passed a valid flex tco filter
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 423 ? packet is multicast the structure of each of the decision filters is shown in figure 3 4. a boxed number indicates that the input is conditioned on a mask bit defined in the mdef register for this rule. the decision filter rules are as follows: ? at least one bit must be set in a mdef register. if all bits are cleared (such as mdef=0x0000), then the decision filter is disabled and ignored. ? all enabled and filters must match for the decision filter to match. an and filter not enabled in the mdef register is ignored. ? if no or filter is enabled in the mdef register, the or filters are ignored in the decision (such as the filter might still match). ? if at least one or filter is enabled in the mdef register, then at least one of the enabled or filters must match for the decision filter to match. figure 5-5. manageability decision filters a decision filter (for any of the seven filters) defines which of the inputs is enabled as part of the rule. the bmc programs a 32-bit rule with the settings as listed in table 5-1 . a set bit enables its corresponding filter to participate in the filtering decision.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 424 october 2010 table 5-1. assignment of decision filters the default mode is that every packet that is directed to the bmc is not directed to host memory. the bmc can also enable the 82598 to direct certain manageability packets to host memory by setting the en_mng2host bit in the manc register and then configuring the 82598 to send manageability packets to the host according to their type by setting the corresponding bits in the manageability to host filter (one bit per each of the seven decision rules). the mng2host register has the following structure: filter and / or input mask bits in mdef[7:0] l2 unicast address and 0 broadcast and 1 manageability vlan and 2 ip address and 3 l2 unicast address or 4 broadcast or 5 multicast and 6 arp request or 7 arp response or 8 neighbor discovery or 9 port 0x298 or 10 port 0x26f or 11 flex port 15:0 or 27:12 flex tco 3:0 or 31:28 bits description default 0 decision filter 0 determines if packets that have passed decision filter 0 are also forwarded to the host os. 1 decision filter 1 determines if packets that have passed decision filter 1 are also forwarded to the host os. 2 decision filter 2 determines if packets that have passed decision filter 2 are also forwarded to the host os. 3 decision filter 3 determines if packets that have passed decision filter 3 are also forwarded to the host os.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 425 all manageability filters are controlled by the bmc only and not by the lan device driver. the bmc enables these filters by issuing the update management receive filter parameters command (see section 5.3.10.1.6 ) with the parameter of 0x60. 5.3.4 smbus transactions this section gives a brief overview of the smbus protocol. following is an example for a format of a typical smbus transaction: the top row of the table identifies the bit length of the field in a decimal bit count. the middle row (bordered) identifies the name of the fields used in the transaction. the last row appears only with some transactions, and lists the value expected for the corresponding field. this value can be either hexadecimal or binary. the shaded fields are fields that are driven by the slave of the transaction. the un-shaded fields are fields that are driven by the master of the transaction. the smbus controller is a master for some transactions and a slave for others. the differences are identified in this section. shorthand field names are listed in table 5-2 and are fully defined in the smbus specification: 4 decision filter 4 determines if packets that have passed decision filter 4 are also forwarded to the host os. 5 unicast and mixed determines if broadcast packets are also forwarded to the host os. 6 global multicast determines if unicast packets are also forwarded to the host os. 7 broadcast determines if multicast packets are also forwarded to the host os. 17 1181 8 11 s slave address wr a command a pec a p 1100 001 0 0 0000 0010 0 [data dependent] 0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 426 october 2010 table 5-2. shorthand field name 5.3.4.1 smbus addressing the smbus addresses that the 82598 responds to depends on the lan mode (teaming/non-teaming). if the lan is in teaming mode (fail-over), the 82598 is presented over the smbus as one device and has one smbus address. while in non-teaming mode in the lan ports, the smbus is presented as two smbus devices on the smbus (two smbus addresses). in dual-address mode, all pass-through functionality is duplicated on the smbus address, where each smbus address is connected to a different lan port. note that it is not allowed to configure both ports to the same smbus address. when a lan function is disabled, the corresponding smbus address is not presented to the bmc (see section 5.3.11.1 ). the smbus addressing mode is defined through the smbus addressing mode bit in the eeprom. the smbus addresses are set in smbus address 0 and smbus address 1 in the eeprom. note that if single- address mode is set, only the smbus address 0 field is valid. the smbus addresses (enabled from the eeprom) can be re-assigned using the smbus arp protocol. in addition to the smbus address values, all parameters of the smbus (smbus channel selection, address mode, and address enable) can be set only through eeprom configuration. note that the eeprom is read at 82598 power up and resets. all smbus addresses should be in network byte order (nbo); msb first. 5.3.4.2 smbus arp functionality the 82598 supports the smbus arp protocol as defined in the smbus 2.0 specification. the 82598 is a persistent slave address device so its smbus address is valid after power-up and loaded from the eeprom. the 82598 supports all smbus arp commands defined in the smbus specification both general and directed. note: the smbus arp capability can be disabled through the eeprom. 5.3.4.2.1 smbus arp flow smbus arp flow is based on the status of two flags: ? av (address valid): this flag is set when the 82598 has a valid smbus address. ? ar (address resolved): this flag is set when the 82598 smbus address is resolved (smbus address was assigned by the smbus arp process). field name definition s smbus start symbol p smbus stop symbol pec packet error code a ack (acknowledge) n nack (not acknowledge) rd read operation (read value = 1b) wr write operation (write value = 0b)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 427 note: these flags are internal 82598 flags and are not exposed to external smbus devices. since the 82598 is a persistent smbus address (psa) device, the av flag is always set, while the ar flag is cleared after power up until the smbus arp process completes. since av is always set, the 82598 always has a valid smbus address. when the smbus master needs to start an smbus arp process, it resets (in terms of arp functionality) all devices on the smbus by issuing either prepare to arp or reset device commands. when the 82598 accepts one of these commands, it clears its ar flag (if set from previous smbus arp process), but not its av flag (the current smbus address remains valid until the end of the smbus arp process). clearing the ar flag means that the 82598 responds to the following smbus arp transactions that are issued by the master. the smbus master issues a get udid command (general or directed) to identify the devices on the smbus. the 82598 always responds to the directed command and to the general command only if its ar flag is not set. after the get udid, the master assigns the 82598 smbus address by issuing an assign address command. the 82598 checks whether the udid matches its own udid and if it matches, it switches its smbus address to the address assigned by the command (byte 17). after accepting the assign address command, the ar flag is set and from this point (as long as the ar flag is set), the 82598 does not respond to the get udid general command. note that all other commands are processed even if the ar flag is set. the 82598 stores the smbus address that was assigned in the smbus arp process in the eeprom, so at the next power up, it returns to its assigned smbus address. smbus arp flow shows the 82598 smbus arp flow.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 428 october 2010 figure 5-6. smbus arp flow 5.3.4.2.2 smbus arp udid content the udid provides a mechanism to isolate each device for the purpose of address assignment. each device has a unique identifier. the 128-bit number is comprised of the following fields: 1 byte 1 byte 2 bytes 2 bytes 2 bytes 2 bytes 2 bytes 4 bytes device capabilities version/ revision vendor id device id interface subsystem vendor id subsystem device id vendor specific id see below see below 0x8086 0x10aa 0x0004 0x0000 0x0000 see below msb lsb
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 429 where: device capabilities: dynamic and persistent address, pec support bit: version/revision: udid version 1, silicon revision: silicon revision id: vendor id: the device manufacturer?s id as assigned by the sbs implementers? forum or the pci sig. constant value: 0x8086 device id: the device id as assigned by the device manufacturer (identified by the vendor id field). constant value: 0x10aa interface: identifies the protocol layer interfaces supported over the smbus connection by the device. in this case, smbus version 2.0 constant value: 0x0004 subsystem fields: these fields are not supported and return zeros. 76 5 4 3 2 1 0 address type reserved (0) reserved (0) reserved (0) reserved (0) reserved (0) pec supported 0b 1b 0b 0b 0b 0b 0b 0b msb lsb 76543 2 1 0 reserved (0) reserved (0) udid version silicon revision id 0b 0b 001b see below msb lsb silicon version revision id a0 000b a1 001b a2 010b
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 430 october 2010 vendor specific id: four lsb bytes of the device ethernet mac address. the device ethernet address is taken from words 0x2:0x0 in the eeprom. note that in the 82598 there are two mac addresses (one for each port). bit 0 of the port 1 mac address has the inverted value of bit 0 from the eeprom. 5.3.4.2.3 smbus arp in dual/single mode the 82598 operates in either single smbus address mode or in dual smbus address mode. these modes reflect its smbus arp behavior. while operating in single mode, the 82598 presents itself on the smbus as one device and only responds to smbus arp as one device. in this case, the 82598's smbus address is smbus address 0 as defined in the eeprom smbus arp address word. the 82598 has only one ar and av flag. the vendor id, the mac address of the lan's port, is taken from the port 0 address. in dual mode, the 82598 responds as two smbus devices having two sets of ar/av flags (one for each port). the 82598 responds twice to the smbus arp master, once each for each port. both smbus addresses are taken from the smbus arp address word of the eeprom. note that the unique device identifier (udid) is different between the two ports in the version id field, which represents the mac address and is different between the two ports. it is recommended that the 82598 first respond as port 0, and only when the address is assigned, to start responding as port 1 to the get udid command. 5.3.4.3 concurrent smbus transactions in single-address mode, concurrent smbus transactions (receive, transmit and configuration read/ write) are allowed without limitation. transmit fragments can be sent between receive fragments and configuration read/write commands can also issue between receive and transmit fragments. in dual-address mode, the same rules apply to concurrent traffic between the two addresses supported by the 82598. note: packets can only be transmitted from one port/device at a given time. as a result, the bmc must finish sent packets (send a last fragment command) from one port before starting the transmission for the other port. 5.3.5 smbus notification methods the 82598 supports three methods of notifying the bmc that it has information that needs to be read by the bmc: ? smbus alert ? asynchronous notify ? direct receive the notification method that is used by the 82598 can be configured from the smbus using the receive enable command. this default method is set by the eeprom in the pass-through init field. the following events cause the 82598 to send a notification event to the bmc: ? receiving a lan packet that is designated to the bmc. 1 byte 1 byte 1 byte 1 byte mac address, byte 3 mac address, byte 2 mac address, byte 1 mac address, byte 0 msb lsb
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 431 ? receiving a request status command from the bmc initiates a status response. ? status change has occurred and the 82598 is configured to notify the external bmc at one of the status changes. ? change in any in the status data 1 bits of the read status command. there can be cases where the bmc is hung and therefore not responding to the smbus notification. the 82598 has a time-out value (defined in the eeprom) to avoid hanging while waiting for the notification response. if the bmc does not respond until the time out expires, the notification is de-asserted and all pending data is silently discarded. note that the smbus notification time-out value can only be set in the eeprom, the bmc cannot modify this value. 5.3.5.1 smbus alert and alert response method the smbus alert# (smbalert_n) signal is an additional smbus signal that acts as an asynchronous interrupt signal to an external smbus master. the 82598 asserts this signal each time it has a message that it needs the bmc to read and if the chosen notification method is the smbus alert method. note that the smbus alert method is an open-drain signal which means that other devices besides the 82598 can be connected on the same alert pin. as a result, the bmc needs a mechanism to distinguish between the alert sources. the bmc can respond to the alert, by issuing an ara cycle command, to detect the alert source device. the 82598 responds to the ara cycle with its own smbus slave address (if it was the smbus alert source) and de-asserts the alert when the ara cycle is completes. following the ara cycle, the bmc issues a read command to retrieve the 82598 message. some bmcs do not implement the ara cycle transaction. these bmcs respond to an alert by issuing a read command to the 82598 (0xc0/0xd0 or 0xde). the 82598 always responds to a read command, even if it is not the source of the notification. the default response is a status transaction. if the 82598 is the source of the smbus alert, it replies the read transaction and then de-asserts the alert after the command byte of the read transaction. note: in smbus alert mode, the smbalert_n pin is used for notification. in dual-address mode, both devices generate alerts on events that are independent of each other. the ara cycle is a smbus receive byte transaction to smbus address 0x18. note that the ara transaction does not support pec. the alert response address transaction format is shown in figure 5-7 . figure 5-7. smbus ara cycle format 17118 11 s alert response address rd a slave device address a p 0001 100 0 0 1
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 432 october 2010 5.3.5.2 asynchronous notify method when configured using the asynchronous notify method, the 82598 acts as a smbus master and notifies the bmc by issuing a modified form of the write word transaction. the asynchronous notify transaction smbus address and data payload is configured using the receive enable command or using the eeprom defaults. note that the asynchronous notify is not protected by a pec byte. figure 5-8. asynchronous notify command format the target address and data byte low/high is taken from the receive enable command or eeprom configuration. 5.3.5.3 direct receive method if configured, the 82598 has the capability to send a message it needs to transfer to the external bmc as a master over the smbus instead of alerting the bmc and waiting for it to read the message. the message format is shown below. note that the command that is used is the same command that is used by the external bmc in the block read command. the opcode that the 82598 puts in the data is also the same as it put in the block read command of the same functionality. the rules for the f and l flags (bits) are also the same as in the block read command. 1711711 s target address wr a sending device address a . . . bmc slave address 0 0 mng slave smbus address 0 0 81 8 11 data byte low a data byte high a p interface 0 alert value 0 171111 6 1 s target address wr a f l command a . . . bmc slave address 0 0 first flag last flag receive tco command 01 0000b 0
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 433 figure 5-9. direct receive transaction format 5.3.6 1 mhz smbus support smbus specification defines the maximum frequency of the smbus as 100 khz. the 82598 smbus can be activated up to frequency of 1 mhz. when operating at 1 mhz, few of the smbus specification parameters are violated. the regular smbus can be activated in two modes: slow, which meets the smbus specification requirements (can be activated up to 400 khz without violating hold and setup time) and fast, which can be operated up to 1 mhz, but does not meet the smbus specification. this configuration is only available via an eeprom setting. the eeprom pass-through smbus connection field defines the smbus mode (slow smbus/fast smbus). the slow smbus dc parameters are defined in the smbus 2.0 specification. 5.3.7 receive tco flow the 82598 is used as a channel for receiving packets from the network link and passing them to the external bmc. the bmc configures the 82598 to pass these specific packets to the bmc. once a full packet is received from the link and identified as a manageability packet that should be transferred to the bmc, the 82598 starts the receive tco flow to the bmc. the 82598 uses the smbus notification method to notify the bmc that it has data to deliver. since the packet size might be larger than the maximum smbus fragment size, the packet is divided into fragments, where the 82598 uses the maximum fragment size allowed in each fragment (configured via the eeprom). the last fragment of the packet transfer is always the status of the packet. as a result, the packet is transferred in at least two fragments. the data of the packet is transferred as part of the receive tco lan packet transaction. when smbus alert is selected as the bmc notification method, the 82598 notifies the bmc on each fragment of a multi fragment packet. when asynchronous notify is selected as the bmc notification method, the 82598 notifies the bmc only on the first fragment of a received packet. it is the bmc's responsibility to read the full packet including all the fragments. any timeout on the smbus notification results in discarding the entire packet. any nack by the bmc causes the fragment to be re-transmitted to the bmc on the next receive packet command. the maximum size of the received packet is limited by the 82598 hardware to 1536 bytes. packets larger then 1536 bytes are silently discarded. any packet smaller than 1536 bytes is processed by the 82598. 5.3.8 transmit tco flow the 82598 is used as the channel for transmitting packets from the external bmc to the network link. the network packet is transferred from the bmc over the smbus and then, when fully received by the 82598, is transmitted over the network link. 81 8 1 1 8 11 byte count a data byte 1 a . . . a data byte n a p n0 0 0 0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 434 october 2010 in dual-address mode, each smbus address is connected to a different lan port. when a packet is received during a smbus transaction using smbus address #0, it is transmitted to the network using lan port #0 and is transmitted through lan port #1, if received on smbus address #1. in single address mode, the transmitted port is chosen according to the fail-over algorithm. the 82598 supports packets up to an ethernet packet length of 1536 bytes. since smbus transactions can only be up to 240 bytes in length, packets might need to be transferred over the smbus in more than one fragment. this is achieved using the f and l bits in the command number of the transmit tco packet block write command. when the f bit is set, it is the first fragment of the packet. when the l bit is set, it is the last fragment of the packet. when both bits are set, the entire packet is in one fragment. the packet is sent over the network link, only after all its fragments are received correctly over the smbus. the maximum smbus fragment size is defined within the eeprom and cannot be changed by the bmc. if the packet sent by the bmc is larger than 1536 bytes, than the packet is silently discarded by the 82598. the minimum packet length defined by the 802.3 spec is 64 bytes. the 82598 pads packets that are less than 64 bytes to meet the specification requirements (there is no need for the external bmc to pad packets less than 64 bytes). if the packet sent by the bmc is larger than 1536 bytes the 82598 silently discards the packet. the 82598 calculates the l2 crc on the transmitted packet and adds its four bytes at the end of the packet. any other packet field (such as xsum) must be calculated and inserted by the bmc (the 82598 does not change any field in the transmitted packet, other than adding padding and crc bytes). if the network link is down when the 82598 has received the last fragment of the packet from the bmc, it silently discards the packet. note that any link down event during the transfer of any packet over the smbus does not stop the operation since the 82598 waits for the last fragment to end to see whether the network link is up again. 5.3.8.1 transmit errors in sequence handling once a packet is transferred over the smbus from the bmc to the 82598, the f and l flags should follow specific rules. the f flag defines that this is the first fragment of the packet; the l flag defines that the transaction contains the last fragment of the packet. flag options during transmit packet transactions lists the different flag options in transmit packet transactions: table 5-3. flag options during transmit packet transactions note: since every other block write command in tco protocol has both f and l flags off, they cause flushing any pending transmit fragments that were previously received. when running the tco transmit flow, no other block write transactions are allowed in between the fragments. previous current action/notes last first accept both. last not first error for the current transaction. current transaction is discarded and an abort status is asserted. not last first error in previous transaction. previous transaction (until previous first) is discarded. current packet is processed. no abort status is asserted. not last not first process the current transaction.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 435 5.3.8.2 tco command aborted flow the 82598 indicates to the bmc an error or an abort condition by setting the tco abort bit in the general status. the 82598 might also be configured to send a notification to the bmc (see section 5.3.10.1.3.3 ). following is a list of possible error and abort conditions: ? any error in the smbus protocol (nack, smbus timeouts, etc.). ? any error in compatibility between required protocols to specific functionality (for example, rx enable command with a byte count not equal to 1/14, as defined in the command specification). ? if the 82598 does not have space to store the transmitted packet from the bmc (in its internal buffer space) before sending it to the link, the packet is discarded and the external bmc is notified via the abort bit. ? error in the f / l bit sequence during multi-fragment transactions. ? an internal reset to the 82598's firmware. 5.3.9 smbus arp transactions note: all smbus arp transactions include the pec byte. 5.3.9.1 prepare to arp this command clears the address resolved flag (set to false). it does not affect the status or validity of the dynamic smbus address and is used to inform all devices that the arp master is starting the arp process: 5.3.9.2 reset device (general) this command clears the address resolved flag (set to false). it does not affect the status or validity of the dynamic smbus address. 1 7 1181 8 11 s slave address wr a command a pec a p 1100 001 0 0 0000 0001 0 [data dependent value] 0 1 7 1181 8 11 s slave address wr a command a pec ap 1100 001 0 0 0000 0010 0 [data dependent value] 0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 436 october 2010 5.3.9.3 reset device (directed) the command field is nacked if bits 7:1 do not match the current 82598 smbus address. this command clears the address resolved flag (set to false) and does not affect the status or validity of the dynamic smbus address. 5.3.9.4 assign address this command assigns the 82598 smbus address. the address and command bytes are always acknowledged. the transaction is aborted (nacked) immediately if any of the udid bytes is different from the 82598 udid bytes. if successful, the manageability system internally updates the smbus address. this command also sets the address resolved flag (set to true). 171181 8 11 s slave address wr a command a pec a p 1100 001 0 0 targeted slave address | 0 0 [data dependent value] 0 17118181 s slave address wr a command a byte count a ? ? ? 1100 001 0 0 0000 0100 0 0001 0001 0 8 1818181 data 1 a data 2 a data 3 a data 4 a ? ? ? udid byte 15 (msb) 0 udid byte 14 0 udid byte 13 0 udid byte 12 0 8 1 8 1 8 181 data 5 a data 6 a data 7 a data 8 a ? ? ? udid byte 11 0 udid byte 10 0 udid byte 9 0 udid byte 8 0
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 437 5.3.9.5 get udid (general and directed) the general get udid smbus transaction supports a constant command value of 0x03 and in directed, supports a dynamic command value equal to the dynamic smbus address. if the smbus address has been resolved ( address resolved flag set to true), the manageability system does not acknowledge (nack) this transaction. if its a general command, the manageability system always acknowledges (acks) as a directed transaction. this command does not affect the status or validity of the dynamic smbus address or the address resolved flag. 8 18181 data 9 a data 10 a data 11 a ? ? ? udid byte 7 0 udid byte 6 0 udid byte 5 0 81 8 1 8 181 data 12 a data 13 a data 14 a data 15 a ? ? ? udid byte 4 0 udid byte 3 0 udid byte 2 0 udid byte 1 0 8181811 data 16 a data 17 a pec a p udid byte 0 (lsb) 0 assigned address 0 [data dependent value] 0 s slave address wr a command a s ? ? ? 1100 001 0 0 see below 0 71181
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 438 october 2010 the get udid command depends on whether or not this is a directed or general command. slave address rd a byte count a ? ? ? 1100 001 1 0 0001 0001 0 8 1818181 data 1 a data 2 a data 3 a data 4 a ? ? ? udid byte 15 (msb) 0 udid byte 14 0 udid byte 13 0 udid byte 12 0 8 1 8 181 8 1 data 5 a data 6 a data 7 a data 8 a ? ? ? udid byte 11 0 udid byte 10 0 udid byte 9 0 udid byte 8 0 8 1 8 181 data 9 a data 10 a data 11 a ? ? ? udid byte 7 0 udid byte 6 0 udid byte 5 0 81 8 18181 data 12 a data 13 a data 14 a data 15 a ? ? ? udid byte 4 0 udid byte 3 0 udid byte 2 0 udid byte 1 0 8181 8 11 data 16 a data 17 a pec ~? p udid byte 0 (lsb) 0 device slave address 0 [data dependent value] 1
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 439 the general get udid smbus transaction supports a constant command value of 0x03. the directed get udid smbus transaction supports a dynamic command value equal to the dynamic smbus address with the lsb bit set. note: bit 0 (lsb) of data byte 17 is always 1b. 5.3.10 smbus pass-through transactions this section details all of the commands (both read and write) that the 82598 smbus interface supports for pass-through. 5.3.10.1 write transactions this section details the commands that the bmc can send to the 82598 over the smbus interface. smbus write transactions table lists the different smbus write transactions supported by the 82598. 5.3.10.1.1 transmit packet command note: if the overall packet length is greater than 1536 bytes, the packet is silently discarded by the 82598. 5.3.10.1.2 request status command an external bmc can initiate a request to read the 82598 manageability status by sending a request status command. when received, the 82598 initiates a notification to an external bmc (when status is ready), after which, an external bmc is able to read the status by issuing this command. the format is as follows: tco command transaction command fragmentation section transmit packet block write first: 0x84 middle: 0x04 last: 0x44 multiple 5.3.10.1.1 transmit packet block write single: 0xc4 single 5.3.10.1.1 request status block write single: 0xdd single 5.3.10.1.2 receive enable block write single: 0xca single 5.3.10.1.3 force tco block write single: 0xcf single 5.3.10.1.4 management control block write single: 0xc1 single 5.3.10.1.5 update mng rcv filter parameters block write single: 0xcc single 5.3.10.1.6 function command byte count data 1 request status 0xdd 1 0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 440 october 2010 5.3.10.1.3 receive enable command the receive enable command is a single fragment command used to configure the 82598. this command has two formats: short, 1-byte legacy format (providing backward compatibility with previous components) and long, 14-byte advanced format (allowing greater configuration capabilities). the receive enable command format is as follows: function cmd byte count data 1 data 2 ? data 7 data 8 ? data 11 data 12 data 13 data 14 legacy receive enable 0xca 1 receive control byte -?--?- - - - advanced receive enable 14 (0x0e) mac addr lsb mac addr msb ip addr lsb ip addr msb bmc smbus addr i/f data byte alert value byte
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 441 table 5-4. receive control byte (data byte) field bit(s) description rcv_en 0 receive tco enable. 0b: disable receive tco packets. 1b: enable receive tco packets. setting this bit enables all manageability receive filtering operations. enabling specific filters is done via the eeprom or through special configuration commands. note: when the rcv_en bit is cleared, all receive tco functionality is disabled, not just the packets that are directed to the bmc (also auto arp packets). rcv_all 1 receive all enable. 0b: disable receiving all packets. 1b: enable receiving all packets. forwards all packets received over the wire that passed l2 filtering to the external bmc. this flag has no effect if bit 0 (enable tco packets) is disabled. en_sta 2 enable status reporting. 0b: disable status reporting. 1b: enable status reporting. field bit(s) description en_arp_res 3 enable arp response. 0b: disable the 82598 arp response. the 82598 treats arp packets as any other packet, for example, packet is forwarded to the bmc if it passed other (non-arp) filtering. 1b: enable the 82598 arp response. the 82598 automatically responds to all received arp requests that match its ip address. note that setting this bit does not change the rx filtering settings. appropriate rx filtering to enable arp request packets to reach the bmc should be set by the bmc or by the eeprom. the bmc ip address is provided as part of the receive enable message (bytes 8-11). if a short version of the command is used, the 82598 uses ip address configured in the most recent long version of the command in which the en_arp_res bit was set. if no such previous long command exists, then the 82598 uses the ip address configured in the eeprom as arp response ipv4 address in the pass-through lan configuration structure. if the cbdm bit is set, the 82598 uses the bmc dedicated mac address in arp response packets. if the cbdm bit is not set, the bmc uses the host mac address. nm 5:4 notification method. define the notification method the 82598 uses. 00b: smbus alert. 01b: asynchronous notify. 10b: direct receive. 11b: not supported. note: in dual smbus address mode, both smbus addresses must be configured with the same notification method.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 442 october 2010 5.3.10.1.3.1 management mac address (data bytes 7:2) ignored if the cbdm bit is not set. this mac address is used to configure the dedicated mac address. in addition, it is used in the arp response packet when the en_arp_res bit is set. this mac address is also used when cbdm bit is set in subsequent short versions of this command. 5.3.10.1.3.2 management ip address (data bytes 11:8) this ip address is used to filter arp request packets. 5.3.10.1.3.3 asynchronous notification smbus address (data byte 12) this address is used for the asynchronous notification smbus transaction and for direct receive. 5.3.10.1.3.4 interface data (data byte 13) interface data byte used in asynchronous notification. 5.3.10.1.3.5 alert value data (data byte 14) alert value data byte used in asynchronous notification. 5.3.10.1.4 force tco command this command causes the 82598 to perform a tco reset, if force tco reset is enabled in the eeprom. the force tco reset clears the data path (rx/tx) of the 82598 to enable the bmc to transmit/receive packets through the 82598. note that in single -address mode, both ports are reset when the command is issued. in dual-address mode, force tco reset is asserted only to the port related to the smbus address the command was issued to. this command should only be used when the bmc is unable to transmit receive and suspects that the 82598 is inoperable. this command also causes the lan device driver to unload. it is recommended to perform a system restart to resume normal operation. the 82598 considers the force tco command as an indication that the operating system is hung and clears the drv_load flag. the force tco reset command format is as follows: reserved 6 reserved. must be set to 1b. cbdm 7 configure the bmc dedicated mac address. note: this bit should be set to 0b when the rcv_en bit (bit 0) is not set. 0b: the 82598 shares the mac address for mng traffic with the host mac address specified in eeprom words 2h:0h. 1b: the 82598 uses the bmc dedicated mac address as a filter for incoming receive packets and as the sender address in arp response packets. the bmc mac address is set in bytes 7:2 in this command. if the short version of the command is used, the 82598 uses the mac address configured in the most recent long version of the command in which the cbdm bit was set. if no such previous long command exists, then the 82572 uses the mac address configured in the eeprom as mac address 3 (mmal/h3) in the pass-through lan configuration structure. when the dedicated mac address feature is activated, the 82598 uses the following registers to filter in all the traffic addressed to the bmc mac. the bmc should not modify these registers as follows: manageability decision filter - mdef7 (and corresponding bit 7 in management control to host register - manc2h), manageability mac address low - mmal3 and manageability mac address high - mmah3 (and corresponding bit 3 of manageability filters valid - mfval).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 443 where tco mode is: 5.3.10.1.5 management control this command is used to set generic manageability parameters. the parameters list is shown in management control command parameters/content. the command is 0xc1 which states that it is a management control command. the first data byte is the parameter number and the data after words (length and content) are parameter specific as shown in management control command parameters/ content. note: if the parameter that the bmc sets is not supported by the 82598. the 82598 does not nack the transaction. after the transaction ends, the 82598 discards the data and asserts a transaction abort status. the management control command format is as follows: function command byte count data 1 force tco reset 0xcf 1 tco mode field bit(s) description do_tco_rst 0 perform tco reset. 0b: do nothing. 1b: perform tco reset. reserved 7:1 reserved (set to 0x00). function command byte count data 1 data 2 ? data n management control 0xc1 n parameter number parameter dependent
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 444 october 2010 table 5-5. management control command parameters/content 5.3.10.1.6 update management receive filter parameters this command is used to set the manageability receive filters parameters. the command is 0xcc. the first data byte is the parameter number and the data that follows (length and content) are parameter specific as listed in management rcv filter parameters. note: if the parameter that the bmc sets is not supported by the 82598, then the 82598 does not nack the transaction. after the transaction ends, the 82598 discards the data and asserts a transaction abort status. the update management rcv receive filter parameters command format is as follows: management rcv filter parameters lists the different parameters and their content. parameter # parameter data keep phy link up 0x00 a single byte parameter: data 2: bit 0: set to indicate that the phy link for this port should be kept up throughout system resets. this is useful when the server is reset and the bmc needs to keep connectivity for a manageability session. bit [7:1] reserved. 0b: disabled. 1b: enabled. function command byte count data 1 data 2 ? data n update manageability filter parameters 0xcc n parameter number parameter dependent
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 445 table 5-6. management rcv filter parameters parameter number parameter data filters enables 0x1 defines the generic filters configuration. the structure of this parameter is four bytes as the manc register. note: the general filter enable is in the receive enable command that enables receive filtering. management-to-host configuration 0xa this parameter defines which of the packet types identified as manageability packets in the receive path are directed to the host memory. data 5:2 = mng2h register bits. fail-over configuration 0xb fail-over register configuration. the bytes of this parameter are loaded into the fail-over configuration register. see section 5.3.11.3 for more information. data 2:5 = fail-over configuration register (bit 0 of data 2 is bit 0 of the configuration register.). flex filter 0 enable mask and length 0x10 flex filter 0 mask. data 17:2 = mask. bit 0 in data 2 is the first bit of the mask. data 19:18 = reserved. should be set to 00b. date 20 = flexible filter length. flex filter 0 data 0x11 data 2 = group of flex filter?s bytes: 0x0 = bytes 0-29 0x1 = bytes 30-59 0x2 = bytes 60-89 0x3 = bytes 90-119 0x4 = bytes 120-127 data 3:32 = flex filter data bytes. data 3 is lsb. group's length is not a mandatory 30 bytes; it might vary according to filter's length and must not be padded by zeros. note: using this command to configure the filters data must be done after the flex filter mask command is issued and the mask is set. flex filter 1 enable mask and length 0x20 same as parameter 0x10 but for filter 1. flex filter 1 data 0x21 same as parameter 0x11 but for filter 1. flex filter 2 enable mask and length 0x30 same as parameter 0x10 but for filter 2. flex filter 2 data 0x31 same as parameter 0x11 but for filter 2. flex filter 3 enable mask and length 0x40 same as parameter 0x10 but for filter 3. flex filter 3 data 0x41 same as parameter 0x11 but for filter 3. parameter number parameter data
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 446 october 2010 5.3.10.2 read transactions (82598 to bmc) this section details the pass-through read transactions that the bmc can send to the 82598 over the smbus. smbus read transactions lists the different smbus read transactions supported by the 82598. all the read transactions are compatible with smbus read block protocol format. filters valid 0x60 four bytes to determine which of the 82598 filter registers contain valid data. loaded into the mfval0 and mfval1 registers. should be updated after the contents of a filter register are updated. data 2: msb of mfval. ... data 5: lsb of mfval. decision filters 0x61 five bytes are required to load the manageability decision filters (mdef). data 2: decision filter number. data 3: msb of mdef register for this decision filter. ... data 6: lsb of mdef register for this decision filter. vlan filters 0x62 three bytes are required to load the vlan tag filters. data 2: vlan filter number. data 3: msb of vlan filter. data 4: lsb of vlan filter. flex port filters 0x63 three bytes are required to load the manageability flex port filters. data 2: flex port filter number. data 3: msb of flex port filter. data 4: lsb of flex port filter. ipv4 filters 0x64 five bytes are required to load the ipv4 address filter. data 2: ipv4 address filter number (3:0). data 3: msb of ipv4 address filter. ? data 6: lsb of ipv4 address filter. ipv6 filters 0x65 17 bytes are required to load the ipv6 address filter. data 2: ipv6 address filter number (3:0). data 3: msb of ipv6 address filter. ? data 18: lsb of ipv6 address filter. mac filters 0x66 seven bytes are required to load the mac address filters. data 2: mac address filters pair number (3:0). data 3: msb of mac address. ? data 8: lsb of mac address.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 447 table 5-7. smbus read transactions 0xc0 or 0xd0 commands are used for more than one payload. if bmc issues these read commands, and the 82598 has no pending data to transfer, it always returns as default opcode 0xdd with the 82598 status and does not nack the transaction. 5.3.10.2.1 receive tco lan packet transaction the bmc uses this command to read packets received on the lan and its status. when the 82598 has a packet to deliver to the bmc, it asserts the smbus notification for the bmc to read the data (or direct receive). upon receiving notification of the arrival of a lan receive packet, the bmc begins issuing a receive tco packet command using the block read protocol. a packet can be transmitted to the bmc in at least two fragments (at least one for the packet data and one for the packet status). as a result, bmc should follow the f and l bit of the op-code. the op-code can have these values: ? 0x90 - first fragment ? 0x10 - middle fragment ? when the opcode is 0x50, this indicates the last fragment of the packet, which contains packet status. if a notification timeout is defined (in the eeprom) and the bmc does not finish reading the whole packet within the timeout period, since the packet has arrived, the packet is silently discarded. following is the receive tco packet format and the data format returned from the 82598. tco command transaction command opcode fragments section receive tco packet block read 0xd0 or 0xc0 first: 0x90 middle: 0x10 last 1 : 0x50 1. the last fragment of the receive tco packet is the packet status. multiple 5.3.10.2.1 read status block read 0xd0 or 0xc0 or 0xde single: 0xdd single 5.3.10.2.2 get system mac address block read 0xd4 single: 0xd4 single 5.3.10.2.3 read configuration block read 0xd2 single: 0xd2 single 5.3.10.2.4 read management parameters block read 0xd1 single: 0xd1 single 5.3.10.2.5 read management rcv filter parameters block read 0xcd single: 0xcd single 5.3.10.2.6 read receive enable configuration block read 0xda single: 0xda single 5.3.10.2.7 function command receive tco packet 0xc0 or 0xd0
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 448 october 2010 5.3.10.2.1.1 receive tco lan status payload transaction this transaction is the last transaction that the 82598 issues when a packet received from the lan is transferred to the bmc. the transaction contains the status of the received packet. the format of the status transaction is as follows: the status is 16 bytes where byte 0 (bits 7:0) is set in data 2 of the status and byte 15 in data 17 of the status. tco lan packet status data lists the content of the status data. function byte count data 1 (op- code) data 2 ? data n receive tco first fragment n 0x90 packet data byte ? packet data byte receive tco middle fragment n 0x10 packet data byte receive tco last fragment 0x50 packet data byte function byte count data 1 (op- code) data 2 ? data 17 (status data) receive tco long status 17 (0x11) 0x50 see below
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 449 table 5-8. tco lan packet status data bit descriptions of each field in can be found in section 4. . name bits description packet length 13:0 packet length including crc, only 14 lsb bits. reserved 24:14 reserved. crc 25 crc insert (crc insertion is needed). reserved 28:26 reserved. vext 29 additional vlan present in packet. vp 30 vlan stripped (vlan tag insertion is needed). reserved 33:31 reserved. flow 34 tx/rx packet (packet direction (0b = rx, 1b = tx). lan 35 lan number. reserved 39:36 reserved. reserved 47:40 reserved. vlan 63:48 the two bytes of the vlan header tag. error 71:64 see error status information. status 79:72 see status info. reserved 87:80 reserved. mng status 127:88 this field should be ignored if receive tco is not enabled (see management status).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 450 october 2010 table 5-9. error status information table 5-10. status info field bits description rxe 7 rx data error ipe 6 ipv4 checksum error tcpe 5 tcp/udp checksum error cxe 4 carrier extension error rsv 3 reserved seq 2 sequence error se 1 symbol error ce 0 crc error or alignment error field bits description udpv 7 checksum field is valid and contains checksum of udp fragment header ipidv 6 ip identification valid crc32v 5 crc 32 valid bit indicates that the crc32 check was done and a valid result was found reserved 4 reserved ipcs 3 ipv4 checksum calculated on packet tcpcs 2 tcp checksum calculated on packet udpcs 1 udp checksum calculated on packet reserved 0 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 451 table 5-11. management status 5.3.10.2.2 read status command the bmc should use this command after receiving a notification from the 82598 (such as smbus alert). the 82598 also sends a notification to the bmc in either of the following two cases: ? the bmc asserts a request for reading the status. ? the 82598 detects a change in one of the status data 1 bits (and was set to send status to the bmc on status change) in the receive enable command. note: commands 0xc0/0xd0 are for backward compatibility and can be used for other payloads. the 82598 defines these commands in the opcode as well as which payload this transaction is. when the 0xde command is set, the 82598 always returns opcode 0xdd with the 82598 status. the bmc reads the event causing the notification, using the read status command as follows: name bits description pass rmcp 0x026f 0 set when the udp/tcp port of the manageability packet is 0x26f. pass rmcp 0x0298 1 set when the udp/tcp port of the manageability packet is 0x298. pass mng broadcast 2 set when the manageability packet is a broadcast packet. pass mng neighbor 3 set when the manageability packet neighbor discovery packet. pass arp request/arp response 4 set when the manageability packet is arp response/request packet. reserved 7:5 reserved. pass mng vlan filter index 10:8 mng vlan address match 11 set when the manageability packet match one of the mng vlan filters. unicast address index 14:12 match any of the four unicast mac address. unicast address match 15 match any of the four unicast mac address. l4 port filter index 22:16 indicate the flex filter number. l4 port match 23 match any of the udp/tcp port filters. flex tco filter index 26:24 if bit 27 is set, this field indicates which tco filter was matched. flex tco filter match 27 set if a flexible filter matched. ip address index 29:28 ip filter number. (ipv4 or ipv6). ip address match 30 match any of the ip address filters. ipv4/ipv6 match 31 ipv4 match or ipv6 match. this bit is valid only if the bit 30 (ip match bit) or bit 4 (arp match bit) are set. decision filter match 39:32 match decision filter.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 452 october 2010 note: the 82598 response to one of the commands (0xc0 or 0xd0) in a given time as defined in the smbus notification timeout and flags word in the eeprom. status data byte 1 lists the status data byte 1 parameters. function command read status 0xc0 or 0xd0 or 0xde function byte count data 1 (op-code) data 2 (status data 1) data 3 (status data 2) receive tco partial status 3 0xdd see below
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 453 table 5-12. status data byte 1 status data byte 2 is used by the bmc to indicate whether the lan device driver is alive and running. the lan device driver valid indication is a bit set by the lan device driver during initialization; the bit is cleared when the lan device driver enters a dx state or is cleared by the hardware on a pci reset. bits 2 and 1 indicate that the lan device driver is stuck. bit 2 indicates whether the interrupt line of the lan function is asserted. bit 1 indicates whether the lan device driver dealt with the interrupt line before the last read status cycle. table 5-13 lists status data byte 2. bit name description 7 reserved reserved. 6 tco command aborted 1b = a tco command abort event occurred since the last read status cycle. 0b = a tco command abort event did not occur since the last read status cycle. 5 link status indication 0b = lan link down. 1b = lan link up 1 . 1. when the 82598 is operating in teaming mode, and presented as one smbus device, the link indication is 0b only when both link s (on both ports) are down. if one of the lans is disabled, its link is considered to be down. 4 phy link forced up contains the value of the phy_link_up bit. when set, indicates that the phy link is configured to keep the link up. 3 initialization indication 0b = an eeprom reload event has not occurred since the last read status cycle. 1b = an eeprom reload event has occurred since the last read status cycle 2 . 2. this indication is asserted when the 82598 manageability block reloads the eeprom and its internal database is updated to the eeprom default values. this is an indication that the external bmc should reconfigure the 82598, if other values other than the eeprom default should be configured. 2 reserved reserved. 1:0 power state 00b = dr state. 01b = d0u state. 10b = d0 state. 11b = d3 state 3 . 3. in single-address mode, the 82598 reports the highest power-state modes in both devices. the "d" state is marked in this orde r: d0, d0u, dr, and d3.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 454 october 2010 table 5-13. status data byte 2 note: when the 82598 is in teaming mode, the bits listed in status data byte 2 represent both cores: 1. the lan device driver alive indication is set if one of the lan device drivers is alive. 2. the lan interrupt is considered asserted if one of the interrupt lines is asserted. 3. the icr is considered read if one of the icrs was read (lan 0 or lan 1). status data byte 2 (bits 2 and 1) lists the possible values of bits 2 and 1 and what the bmc can assume from the bits: table 5-14. status data byte 2 (bits 2 and 1) note: the bmc reads should consider the time it takes for the lan device driver to deal with the interrupt (in ? s). note that excessive reads by the bmc can give false indications. bit name description 5 reserved reserved. 4 reserved reserved. 3 driver valid indication 0b = lan driver is not alive. 1b = lan driver is alive. 2 interrupt pending indication 1b = lan interrupt line is asserted. 0b = lan interrupt line is not asserted. 1 icr register read/write 1b = icr register was read since the last read status cycle. 0b = icr register was not read since the last read status cycle. reading the icr indicates that the driver has dealt with the interrupt that was asserted. 0 reserved reserved previous current description don?t care 00b interrupt is not pending (ok). 00b 01b new interrupt is asserted (ok). 10b 01b new interrupt is asserted (ok). 11b 01b interrupt is waiting for reading (ok). 01b 01b interrupt is waiting for reading by the driver for more than one read cycle (not ok). possible drive hang state. don?t care 11b previous interrupt was read and current interrupt is pending (ok). don?t care 10b interrupt is not pending (ok).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 455 5.3.10.2.3 get system mac address the get system mac address returns the system mac address over to the smbus. this command is a single-fragment read block transaction that returns the following data: note: this command returns the mac address configured in eeeprom offset 0. the format is as follows: data returned from the 82598: 5.3.10.2.4 read configuration this command can be used by the bmc to read the csr?s from the manageability firmware. in order to read a manageability csr, the bmc executes two smbus transactions. the first transaction is a block write that sets the csr that the bmc needs to read. the second transaction is a block read that reads the csr value. the block write transaction is as follows: following the block write, the bmc issues a block read that reads the parameter that was set in the block write command: for example, if the bmc wants to read the manc register, it would issue a block write with command of 0xc6, length of 3 and parameters of 0x00, 0x58, 0x20. function command get system mac address 0xd4 function byte count data 1 (op-code) data 2 ? data 7 get system mac address 7 0xd4 mac address msb ? mac address lsb function command byte count data 1 data 2 data 3 write configuration 0xc6 3 csr number msb ? csr number lsb function command read configuration 0xd2
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 456 october 2010 5.3.10.2.5 read management parameters in order to read the management parameters, the bmc executes two smbus transactions. the first transaction is a block write that sets the parameter that the bmc needs to read. the second transaction is a block read that reads the parameter. the block write transaction is as follows: following the block write, the bmc issues a block read that reads the parameter that was set in the block write command: data returned from the 82598: the returned data is in the same format of the management control command. note that it might be that the parameter that is returned is not the parameter requested by the bmc. the bmc should verify the parameter number (default parameter to be returned is 0x10). if the parameter number is 0xff, it means that the data that the 82598 should supply is not ready yet. the bmc should retry the read transaction. it is the bmc responsibility to follow the previous procedure. in the case where the bmc sends a block read command, which is not preceded by a block write command with byte count = 1b, the 82598 sets the parameter number in the read block transaction to be 0xfe. 5.3.10.2.6 read management receive filter parameters in order to read the management rcv filter parameters, the bmc should execute two smbus transactions. the first transaction is a block write that sets the parameter that the bmc wants to read. the second transaction is block read that read the parameter. function command byte count data 1 management control request 0xc1 1 parameter number function command read management parameter 0xd1 function byte count data 1 (op- code) data 2 data 3 ? data n read management parameter n 0xd1 parameter number parameter dependent
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 457 following is the block write transaction: following the block write, the bmc should issue a block read that reads the parameter that was set in the block write command as follows: function command byte count data 1 data 2 update mng rcv filter parameters 0xcc 1 or 2 parameter number parameter data parameter # parameter data filters enable 0x01 none mng2h configuration 0x0a none fail-over configuration 0x0b none flex filter 0 enable mask and length 0x10 none flex filter 0 data 0x11 data 2: group of flex filter?s bytes: 0x0 = bytes 0-29 0x1 = bytes 30-59 0x2 = bytes 60-89 0x3 = bytes 90-119 0x4 = bytes 120-127 flex filter 1 enable mask and length 0x20 none flex filter 1 data 0x21 same as parameter 0x11 but for filter 1. flex filter 2 enable mask and length 0x30 none flex filter 2 data 0x31 same as parameter 0x11 but for filter 2. parameter # parameter data flex filter 3 enable mask and length 0x40 none flex filter 3 data 0x41 same as parameter 0x11 but for filter 3. filters valid 0x60 none decision filters 0x61 one byte to define the accessed manageability decision filter (mdef) data 2 ? decision filter number vlan filters 0x62 one byte to define the accessed vlan tag filter (mavtv) data 2 ? vlan filter number flex ports filters 0x63 one byte to define the accessed manageability flex port filter (mfutp). data 2 ? flex port filter number
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 458 october 2010 following the block write, the bmc issues a block read that reads the parameter that was set in the block write command: data returned from the 82598: the returned data is the same format as the update command. note that it might be that the parameter that is returned is not the parameter requested by the bmc. the bmc should verify the parameter number (default parameter to be returned is 0x1). note: if the parameter number is 0xff then this indicates that the data the 82598 should supply is not ready yet and the bmc should retry the read transaction. it is the bmc responsibility to follow the procedure previously defined. in the case where the bmc sends a block read command that is not preceded by a block write command with byte count = 1b, the 82598 sets the parameter number in the read block transaction as 0xfe. 5.3.10.2.7 read receive enable configuration the bmc uses this command to read the receive configuration data. this data can be configured when using receive enable command or through the eeprom. read receive enable configuration command format (smbus read block) is as follows: ipv4 filter 0x64 one byte to define the accessed ipv4 address filter (mipaf) data 2 ? ipv4 address filter number ipv6 filters 0x65 one byte to define the accessed ipv6 address filter (mipaf) data 2 ? ipv6 address filter number mac filters 0x66 one byte to define the accessed mac address filters pair (mmal, mmah) data 2 ? mac address filters pair number (0-3) function command request mng rcv filter parameters 0xcd function byte count data 1 (op-code) data 2 data 3 ? data n read mng rcv filter parameters n 0xcd parameter number parameter dependent function command read receive enable 0xda
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 459 data returned from the 82598: 5.3.11 lan fail-over in lan teaming mode manageability fail-over is the ability in a dual-port network device (the 82598) to detect that the lan connection on the manageability enabled port is lost, and to enable the other port in the device to receive/transmit manageability packets. when the 82598 operates in teaming mode, the os and the external bmc consider the 82598 as one logical network device. the decision to determine which of the 82598 ports to use is done internally in the 82598 (or in the ans driver in case of the regular receive/ transmit traffic). this section deals with fail-over in teaming mode only. in non-teaming mode, the external bmc should consider the 82598's network ports as two different network devices, and is solely responsible for the fail-over mechanism. 5.3.11.1 fail-over functionality in teaming mode, the 82598 mirrors both the network ports into a single smbus slave device. the 82598 automatically handles the configurations of both network ports. thus, for configurations, receiving and transmitting the bmc should consider both ports as a single entity. when the currently active port for transmission becomes unavailable (for instance, the link is down), the 82598 automatically tries to switch the packet transmission to the other port. thus, as long as one of the ports is valid, the bmc has a valid link indication for the smbus slave. 5.3.11.1.1 transmit functionality in order to transmit a packet, the bmc should issue the appropriate smbus packet transmission commands to the 82598. the 82598 will then automatically choose the transmission port. 5.3.11.1.2 receive functionality when the 82598 receives a packet from any of the teamed ports, it will notifies and forwards the packet to the bmc. note: as both ports might be active (for instance, with a valid link), packets might be received on the currently non-active port. to avoid this, fail-over should be used only in a switched network. 5.3.11.1.3 port switching (fail-over) while in teaming mode, transmit traffic is always transmitted by the 82598 through only one of the ports at any given time. the 82598 might switch the traffic transmission between ports under any of the following conditions: 1. the current transmitting port link is not available. 2. the preferred primary port is enabled and becomes available for transmission. function byte count data 1 (op- code) data 2 data 3 ? data 8 data 9 ? data 12 data 13 data 14 data 15 read receive enable 15 (0x0f) 0xda receive control byte mac addr lsb ? mac addr msb ip addr lsb ? ip addr msb bmc smbus addr i/f data byte alert value byte
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 460 october 2010 5.3.11.1.4 device driver interactions when the lan device driver is present, the decision to switch between the two ports is done by the device driver. when the device driver is absent, this decision is done internally by the 82598. note: when the device driver releases teaming mode, such as when the system state changes, the 82598 reconfigures the lan ports to teaming mode. the 82598 accomplishes this by re- setting the mac address of the two ports to be the teaming address in order to re-start teaming. this is followed by transmitting gratuitous arp packets to notify the network of teaming mode re-setting. 5.3.11.2 fail-over configuration fail-over operation is configured through the fail-over register, as described in table 5-15 . the bmc should configure this register after every initialization indication from the 82598 (such as after every the 82598 firmware reset). the bmc needs to use the update management receive filters command, with parameter 0x0a, detailed in section 5.3.10.1.6 . the different configurations available to the bmc are detailed in this section. note: in teaming mode, both ports should be configured with the same receive manageability filters parameters (eeprom sections for port 0 and port 1 should be identical). 5.3.11.2.1 preferred primary port the bmc might choose one of the network ports (lan0 or lan1) as a preferred primary port for packet transmission. the 82598 uses the preferred primary port as the transmission port each time the link for that port is valid. for example, the 82598 always switches back to the preferred primary port when available. 5.3.11.2.2 gratuitous arps in order to notify the link partner that a port switching has occurred, the 82598 can be configured to automatically send gratuitous arps. these gratuitous arps cause the link partner to update its arp tables to reflect the change. the bmc might enable/disable gratuitous arps, configure the number of gratuitous arps, or the interval between them by modifying the fail-over register. 5.3.11.2.3 link down timeout the bmc can control the timeout for a link to be considered invalid. the 82598 waits on this timeout before attempting to switch from an inactive port. 5.3.11.3 fail-over register this register is loaded at power up from the eeprom. the bmc can change the contents of the fail-over register using the update management receive filters command, with parameter 0x0a, detailed in section 5.3.10.1.6 . table 5-15 lists the register different bits:
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 461 table 5-15. fail-over register 5.3.12 smbus troubleshooting guide bits field initial value read/ write description 0 rmp0en 0x1 ro rcv mng port 0 enable. when this bit is set, it reports that management traffic will be received from port 0. 1 rmp1en 0x1 ro rcv mng port 1 enable. when this bit is set, it reports that management traffic will be received from port 1. 2 mxp 0x0 ro mng xmt port. 0b - reports that management traffic should be transmitted through port 0. 1b ? reports that mng traffic should be transmitted through port 1. 3 prpp 0x0 rw preferred primary port. 0b ? port 0 is the preferred primary port. 1b ? port 1 is the preferred primary port. 4 prppe 0x0 rw preferred primary port enables. 5 reserved 0x0 ro reserved 6 rgaen 0x0 repeated gratuitous arp enable. if this bit is set, the 82598 sends a configurable number of gratuitous arp packets (gac bits of this register) using configurable interval (gati bits of this register) after the following events: ? system move to dx. ? fail-over event initiated the 82598. 8:7 reserved 0x0 ro reserved bits field initial value read/ write description 9 tfoenodx 0x0 rw teaming fail-over enable on dx. enable fail-over mechanism. bits 3:8 are valid only if this bit is set. 10:11 reserved 0x0 ro reserved 12:15 gac 0x0 rw gratuitous arp counter. indicates the number of gratuitous arp that should be sent after a fail- over event and after move to dx. the value of 0b means that there is no limit on the gratuitous arp packets to be sent. 16:23 ldfot 0x0 rw link down fail-over time. defines the time (in seconds) the link should be down before doing a fail- over to the second port. this is also the time that the primary link should be up (after it was down) before the 82598 will fail-over back to the primary port. 24:31 gati 0x0 rw gratuitous arp transmission interval. defines the interval in seconds before retransmission of gratuitous arp packets.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 462 october 2010 this section outlines the most common issues found while working with pass-through using the smbus sideband interface. 5.3.12.1 tco alert line stays asserted after a power cycle after the 82598 resets both of its ports indicates a status change. if the bmc only reads status from one port (slave address) the other one will continue to assert the tco alert line. ideally, the bmc should use the ara transaction (see section 5.3.9 ) to determine which slave asserted the tco alert. many customers only wish to use one port for manageability thus using ara might not be optimal. an alternate to using ara is to configure one of the ports to not report status and to set its smbus timeout period. in this case, the smbus timeout period determines how long a port asserts the tco alert line awaiting a status read from a bmc; by default this value is zero, which indicates an infinite timeout. the smbus configuration section of the eeprom has a smbus notification timeout (ms) field that can be set to a recommended value of 0xff (for this issue). note that this timeout value is for both slave addresses. along with setting the smbus notification timeout to 0xff, it is recommended that the second port be configured in the eeprom to disable status alerting. this is accomplished by having the enable status reporting bit set to 0b for the desired port in the lan configuration section of the eeprom. the last solution for this issue is to have the bmc hard-code the slave addresses to always read from both ports. as with the previous solution, it is also recommend that the second port have status reporting disabled. 5.3.12.2 smbus commands are always nack'd by the 82598 there are several reasons why all commands sent to the 82598 from a bmc could be nack'd. the following are the most common: ? invalid eeprom image - the image itself might be invalid, or it could be a valid image; however, it is not a pass-through image, as such smbus connectivity is disabled. ? the bmc is not using the correct smbus address - many bmc vendors hard-code the smbus address(es) into their firmware. if the incorrect values are hard-coded, the 82598 does not respond. ? the smbus address(es) can also be dynamically set using the smbus arp mechanism. ? the bmc is using the incorrect smbus interface - the eeprom might be configured to use one physical smbus port; however, the bmc is physically connected to a different one. ? bus interference - the bus connecting the bmc and the 82598 might be unstable. 5.3.12.3 smbus clock speed is 16.6666 khz this can happen when the smbus connecting the bmc and the 82598 is also tied into another device (such as a ich6) that has a maximum clock speed of 16.6666 khz. the solution is to not connect the smbus between the 82598 and the bmc to this device.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 463 5.3.12.4 a network based host application is not receiving any network packets reports have been received about an application not receiving any network packets. the application in question was nfs under linux. the problem was that the application was using the rmpc/rmcp+ iana reserved port 0x26f (623), and the system was also configured for a shared mac and ip address with the os and bmc. the management control to host configuration, in this situation, was setup not to send rmcp traffic to the os (this is typically the correct configuration). this means that no traffic send to port 623 was being routed. the solution in this case is to configure the problematic application not to use the reserved port 0x26f. 5.3.12.5 status registers if the eeprom image is configured correctly, the physical connections are valid, and problems still exist, use lanconf or other utilities/drivers to check the appropriate 82598 status registers for other indications. 5.3.12.5.1 firmware semaphore register (fwsm, 0x10148) this register provides a way to find out if the firmware on the 82598 is functioning properly and if so, in what mode. check the error indication bits (24:19), if they are anything other than zero, then the firmware is not going to be fully functional, if at all. the most common errors are: ? eeprom checksum errors - these can be caused by a number of things: ? mismatch in 82598 stepping and eeprom image version (old eeprom image on a new 82598) ? eeprom part too small (recommended minimum size for manageability is 32 kb) ? old utility was used to update the eeprom (always make sure to have the latest versions) ? invalid firmware mode (0x08) if bits 3:1 of the register indicate a firmware mode that is reserved, this error condition can be reset. always make note of the firmware mode, bits 3:1. in nearly all cases, this value should be set to 010b for pass-through mode to an external bmc. the firmware valid bit (15) should be set to 1b to indicate that the firmware is up and running. if it is not set to 1b, then an error code should be indicated in bits 24:19. the reset count bits (18:16) indicate how many times the internal firmware on the 82598 has been reset. this value should be a one (the firmware was reset at power up). if the value is greater than one then there are issues somewhere. note that this counter goes from 0-7 and wraps around. 5.3.12.5.2 management control register (manc 0x5820) this register indicates which filters are enabled. it is possible to configure all of the filters yet not enable them, in which case, no management traffic is routed to the bmc. or, the bmc might be receiving undesired traffic, such as arp requests when the 82598 was configured to do automatic arp responses. check this register if getting unwanted traffic or if packets aren?t getting sent to the bmc.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 464 october 2010 bit 17 ( receive tco packets enable ) must also be set in order for any packets are sent to a bmc. note that it doesn?t matter what the other enabled filters are, if this one is off, no packets are sent to the bmc. bit 21 ( enable management-to-host ) enables or disables the various filters that also allow manageability traffic (all those that pass the filters in the 82598) to optionally be passed to the os. 5.3.12.5.3 management control to host register (manc2h 0x5860) the 82598 has a large number of filtering mechanisms by which network traffic can be directed to a bmc. traffic sent to the bmc is typically not sent to the host os as well. for example, the os is not interested in rmcp/rmcp+ traffic. however, the os might be interested in arp requests. if the 82598 is configured for automatic arp requests, this means that a filter for arp requests has been configured and enabled, if the arp request matches that of the bmc, then that arp request is not sent to the os unless specifically configured to do so. this is what the manc2h register shows, which manageability filters to also pass the data up to the os as well as the bmc. using the arp request example; typically it is desirable to allow the os to receive these, as such, bit 7 ( arp request ) should be set. 5.3.12.6 unable to transmit packets from the bmc if the bmc has been transmitting and receiving data without issue for a period of time and then begins to receive nacks from the 82598 when it attempts to write a packet, the problem is most likely due to the fact that the buffers internal to the 82598 are full of data that has been received from the network; however, has yet to be read by the bmc. being an embedded device, the 82598 has limited buffers, which it shares for receiving and transmitting data. if a bmc does not keep the incoming data read, the 82598 can be filled up, which does not allow the bmc to transmit anymore data, resulting in nacks. if this situation occurs, the recommended solution is to have the bmc issue a receive enable command to disable anymore incoming data, go read all the data from the 82598 and then use the receive enable command to enable incoming data once again. 5.3.12.7 smbus fragment size the smbus specification indicates a maximum smbus transaction size of 32 bytes. most of the data passed between the 82598 and the bmc over the smbus is rmcp/rmcp+ traffic, which by its very nature (udp traffic) is significantly larger than 32 bytes in length, thus requiring multiple smbus transactions to move a packet from the 82598 to the bmc or to send a packet from the bmc to the 82598. recognizing this bottleneck, the 82598 can handle up to 240 bytes of data within a single transaction. this is a configurable setting within the eeprom. the default value in the eeprom images is 32, per the smbus specification. if performance is an issue, it is recommended that you increase this size. during the initialization phase, the firmware within the 82598 allocates buffers based upon the smbus fragment size setting within the eeprom. the 82598 firmware has a finite amount of ram for its use, as such the larger the smbus fragment size, the fewer buffers it can allocate. as such, the bmc implementation must take care to send data over the smbus in an efficient way. for example, the 82598 firmware has 3 kb of ram it can use for buffering smbus fragments. if the smbus fragment size is 32 bytes then the firmware could allocate 96 buffers of size 32 bytes each. as a result, the bmc could then send a large packet of data (such as kvm) that is 800 bytes in size in 25 fragments of size 32 bytes apiece.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 465 however, this might not be the most efficient way because the bmc must break the 800 bytes of data into 25 fragments and send each one at a time. if the smbus fragment size is changed to 240 bytes, the 82598 firmware can create 12 buffers of 240 bytes each to receive smbus fragments. the bmc can now send that same 800 bytes of kvm data in only four fragments, which is much more efficient. the problem of changing the smbus fragment size in the eeprom is if the bmc does not also reflect this change. if a programmer changes the smbus fragment size in the 82598 to 240 bytes and then wants to send 800 bytes of kvm data, the bmc can still only send the data in 32 byte fragments. as a result, the firmware runs out of memory. this is because the 82598 firmware created the 12 buffers of 240 bytes each for fragments, however the bmc is only sending fragments of size 32 bytes. this results in a memory waste of 208 bytes per fragment in this case, and when the bmc attempts to send more than 12 fragments in a single transaction, the 82598 nacks the smbus transaction due to not enough memory to store the kvm data. in summary, if a programmer increases the size of the smbus fragment size in the eeprom, which is recommended for efficiency purposes, take care to ensure that the bmc implementation reflects this change and uses that fragment size to its fullest when sending smbus fragments. 5.3.12.8 enable xsum filtering if xsum filtering is enabled, the bmc does not need to perform the task of checking this checksum for incoming packets. only packets that have a valid xsum is passed to the bmc, all others are silently discarded. this is a way to offload some work from the bmc. 5.3.12.9 still having problems? if problems still exist, contact your field representative. before contacting, be prepared to provide the following: ? the contents of status registers: ? 0x5820 ? 0x5860 ? 0x10148 ? a smbus trace if possible ? a dump of the eeprom image ? this should be taken from the actual 82598, rather than the eeprom image provided by intel. parts of the eeprom image are changed after writing, such as the physical eeprom size. this information could be key in helping assist in solving an issue. 5.3.13 sample configurations this section provides an overview and sample settings for commonly used filtering configurations. three examples are presented. the examples are in pseudo code format, with the name of the smbus command, followed by the parameters for that command and an explanation. here is a sample: receive enable[00]
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 466 october 2010 utilizing the simple form of the receive enable command, this prevents any packets from reaching the bmc by disabling filtering. example 5-1. shared mac, rmcp-only ports this example will be the most basic configuration. the mac address filtering will be shared with the host operating system and only traffic directed the rmcp ports (26fh & 298h) will be filtered. for this simple example, the bmc must issue gratuitous arps because no filter will be enabled to pass arp requests to the bmc. pseudo code step 1: disable existing filtering receive enable[00] utilizing the simple form of the receive enable command, this prevents any packets from reaching the mc by disabling filtering: receive enable control 40h: bit 0 [0]? disable receiving of packets bit 6 [1] - reserved, must be set to 1 step 2: configure mdef[0] update manageability filter parameters [61, 0, 00000c00] use the update manageability filter parameters command to update decision filters (mdef) (parameter 61h). this will update mdef[0], as indicated by the 2 nd parameter (0). mdef[0] value of 00000c00h: bit 10 [1]? port 298h bit 11 [1]? port 26fh step 3: enable filtering receive enable [45] using the simple form of the receive enable command: receive enable control 05h: bit 0 [1] ? enable receiving of packets bit 2 [1] ? enable status reporting (such as link lost) bit 5:4 [00]? notification method = smb alert bit 6 [1] - reserved, must be set to 1 bit 7 [0]? use shared mac
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 467 table 5-16. mdef results example 5-2. dedicated mac, auto arp response and rmcpport filtering this example shows a common configuration; the bmc has a dedicated mac and ip address. automatic arp responses will be enabled as well as rmcp port filtering. by enabling automatic arp responses the bmc is not required to send the gratuitous arps as it did in the previous example. since arp requests are now filtered, in order for the host to receive the arp requests, the manageability to host filter will be configured to send the arp requests to the host as well. for demonstration purposes, the dedicated mac address will be calculated by reading the system mac address and adding 1 do it, assume the system mac is aabbccdc. the ip address for this example will be 1.2.3.4. additionally, the xsum filtering will be enabled. note that not all intel ethernet controllers support automatic arp responses, please refer to product specific documentation. pseudo code step 1: disable existing filtering receive enable[40] utilizing the simple form of the receive enable command, this prevents any packets from reaching the mc by disabling filtering: receive enable control 40h: manageability decision filter (mdef) filter 0 1 2 3 4 5 6 7 l2 unicast address and broadcast and manageability vlan and ip address and l2 unicast address or broadcast or multicast and arp request or arp response or neighbor discovery or port 0x298 orx port 0x26f or x flex port 15:0 or flex tco 3:0 or
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 468 october 2010 bit 0 [0]? disable receiving of packets bit 6 [1] - reserved, must be set to 1 step 2: read system mac address get system mac address [] reads the system mac address. assume returned aabbccdded for this example. step 3: enable mng2host & xsum filters update manageability filter parameters [01, 00a00000] use the update manageability filter parameters command to update filters enable settings (parameter 1). this set the manageability control (manc) register. manc register 00a00000h: bit 21 [1]- mng2host filter enable bit 23 [1]? xsum filter enable some of the following configuration steps manipulate the manc register indirectly, this command sets all bits except xsum to 0. it is important to either do this step before the others, or to read the value of the manc and then write it back with only bit 32 changed. also note that the xsum enable bit may differ between ethernet controllers, refer to product specific documentation. step 4: configure mdef[0] update manageability filter parameters [61, 0, 00000c00] use the update manageability filter parameters command to update decision filters (mdef) (parameter 61h). this will update mdef[0], as indicated by the 2 nd parameter (0). mdef value of 00000c00h: bit 10 [1]? port 298h bit 11 [1]? port 26fh step 5: configure mdef[1] update manageability filter parameters [61, 1, 00000080] use the update manageability filter parameters command to update decision filters (mdef) (parameter 61h). this will update mdef[1], as indicated by the 2 nd parameter (1). mdef value of 00000080: bit 7 [7]? arp requests when enabling automatic arp responses, the arp requests still go into the manageability filtering system and as such need to be designated as also needing to be sent to the host. for this reason a separate mdef is created with only arp request filtering enabled. refer to the next step for details. step 6: configure the management to host filter update manageability filter parameters [0a, 00000002] use the update manageability filter parameters command to update the management control to host (manc2h) register. manc2h register 00000002: bit 2 [1]? enable mdef[1] traffic to go to host as well this allows arp requests to be passed to both manageability and to the host. specified separate mdef filter for arp requests. if arp requests had been added to mdef[0] and then mdef[0] specified in management to host configuration then not only would arp requests be sent to the mc and host, rmcp
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 469 traffic (ports 26fh and 298h) would have also been sent to both places. the manc2h filter is configured in this step and enabled in step 3. step 7: enable filtering receive enable [cd, aabbccddee, 01020304, 00, 00, 00] using the advanced version receive enable command, the first parameter: receive enable control cdh: bit 0 [1] ? enable receiving of packets bit 2 [1] ? enable status reporting (such as link lost) bit 3 [1] ? enable automatic arp responses bit 5:4 [00]? notification method = smb alert bit 6 [1] - reserved, must be set to 1 bit 7 [1]? use dedicated mac second parameter is the mac address (aabbccddee). third parameter is the ip address(01020304). the last three parameters are zero when the notification method is smb alert.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 470 october 2010 table 5-17. mdef results example 5-3. dedicated mac & ip address this example provided the bmc with a dedicated mac and ip address and allows it to receive arp requests. the bmc is then responsible for responding to arp requests. for demonstration purposes, the dedicated mac address will be calculated by reading the system mac address and adding 1 do it, assume the system mac is aabbccdc. the ip address for this example will be 1.2.3.4. for this example, the receive enable command is used to configure the mac address filter. in order for the bmc to be able to receive arp requests, it will need to specify a filter for this, and that filter will need to be included in the manageability to host filtering so that the host os may also receive arp requests. pseudo code step 1: disable existing filtering receive enable[40] utilizing the simple form of the receive enable command, this prevents any packets from reaching the mc by disabling filtering: receive enable control 40h: bit 0 [0]? disable receiving of packets bit 6 [1] - reserved, must be set to 1 manageability decision filter (mdef) filter 0 1 2 3 4 5 6 7 l2 unicast address and x broadcast and manageability vlan and ip address and l2 unicast address or broadcast or multicast and arp request or x arp response or neighbor discovery or port 0x298 orx port 0x26f or x flex port 15:0 or flex tco 3:0 or
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 471 step 2: - read system mac address get system mac address [] reads the system mac address. assume returned aabbccdded for this example. step 3: configure ip address filter update manageability filter parameters [64, 00, 01020304] use the update manageability filter parameters to configure an ipv4 filter. the 1 st parameter (64h) specifies that we are configuring an ipv4 filter. the 2 nd parameter (00h) indicates which ipv4 filter is being configured, in this case filter 0. the 3 rd parameter is the ip address ? 1.2.3.4. step 4: configure mac address filter update manageability filter parameters [66, 00, aabbccddee] use the update manageability filter parameters to configure a mac address filter. the 1 st parameter (66h) specifies that we are configuring a mac address filter. the 2 nd parameter (00h) indicates which mac address filter is being configured, in this case filter 0. the 3 rd parameter is the mac address - aabbccddee step 5: configure mdef[0] for ip and mac filtering update manageability filter parameters [61, 0, 00000009] use the update manageability filter parameters command to update decision filters (mdef) (parameter 61h). this will update mdef[0], as indicated by the 2 nd parameter (0). mdef value of 00000009: bit 1 [1]- mac address filtering bit 3 [1]? ip address filtering step 6: configure mdef[1] update manageability filter parameters [61, 1, 00000080] use the update manageability filter parameters command to update decision filters (mdef) (parameter 61h). this will update mdef[1], as indicated by the 2 nd parameter (1). mdef value of 00000080: bit 7 [7]? arp requests when filtering arp requests the requests go into the manageability filtering system and as such need to be designated as also needing to be sent to the host. for this reason a separate mdef is created with only arp request filtering enabled. step 7: configure the management to host filter update manageability filter parameters [0a, 00000002] use the update manageability filter parameters command to update the management control to host (manc2h) register. manc2h register 00000002: bit 2 [1]? enable mdef[1] traffic to go to host as well step 8: enable mng2host filter
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 472 october 2010 update manageability filter parameters [01, 00200000] use the update manageability filter parameters command to update filters enable settings (parameter 1). this set the manageability control (manc) register. manc register 00200000h: bit 21 [1]- mng2host filter enable this enables the manc2h filter configured in step 7. step 9: enable filtering receive enable [45] using the simple form of the receive enable command,: receive enable control 45h: bit 0 [1] ? enable receiving of packets bit 2 [1] ? enable status reporting (such as link lost) bit 5:4 [00]? notification method = smb alert bit 6 [1] - reserved, must be set to 1 the resulting mdef filters are as follows: table 5-18. mdef results manageability decision filter (mdef) filter 0 1 2 3 4 5 6 7 l2 unicast address and x broadcast and manageability vlan and ip address and x l2 unicast address or broadcast or multicast and arp request or x arp response or neighbor discovery or port 0x298 or port 0x26f or flex port 15:0 or flex tco 3:0 or
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 473 example 5-4. dedicated mac and vlan tag this example shows an alternate configuration; the bmc has a dedicated mac and ip address, along with a vlan tag of 32h will be required for traffic to be sent to the bmc. this means that all traffic with vlan a matching tag will be sent to the bmc. for demonstration purposes, the dedicated mac address will be calculated by reading the system mac address and adding 1 do it, assume the system mac is aabbccdc. the ip address for this example will be 1.2.3.4 and the vlan tag will be 0032h. it is assumed the host will not be using the same vlan tag as the bmc. if they were to share the same vlan tag then additional filtering would need to be configured to allow vlan tagged non-unicast (such as arp requests) to be sent to the host as well as the bmc using the manageability to host filter capability. additionally, the xsum filtering will be enabled. pseudo code step 1: disable existing filtering receive enable[40] utilizing the simple form of the receive enable command, this prevents any packets from reaching the mc by disabling filtering: receive enable control 40h: bit 0 [0]? disable receiving of packets bit 6 [1] - reserved, must be set to 1 step 2: read system mac address get system mac address [] reads the system mac address. assume returned aabbccdded for this example. step 3: configure xsum filter update manageability filter parameters [01, 00800000] use the update manageability filter parameters command to update filters enable settings (parameter 1). this set the manageability control (manc) register. manc register 00800000h: bit 23 [1]? xsum filter enable note that some of the following configuration steps manipulate the manc register indirectly, this command sets all bits except xsum to 0. it is important to either do this step before the others, or to read the value of the manc and then write it back with only bit 32 changed. also note that the xsum enable bit may differ between ethernet controllers, refer to product specific documentation. step 4: configure vlan 0 filter update manageability filter parameters [62, 0, 0032] use the update manageability filter parameters command to configure vlan filters. parameter 62h indicates update to vlan filter, the 2 nd parameter indicates which vlan filter (0 in this case), the last parameter is the vlan id (0032h). step 5: configure mdef[0] update manageability filter parameters [61, 0, 00000040] use the update manageability filter parameters command to update decision filters (mdef) (parameter 61h). this will update mdef[0], as indicated by the 2 nd parameter (0).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 474 october 2010 mdef value of 00000040: bit 2 [1]? vlan and step 6: - enable filtering receive enable [a5, aabbccddee, 01020304, 00, 00, 00] using the advanced version receive enable command, the first parameter: receive enable control a5h: bit 0 [1] ? enable receiving of packets bit 2 [1] ? enable status reporting (such as link lost) bit 5:4 [00]? notification method = smb alert bit 6 [1] - reserved, must be set to 1 bit 7 [1]? use dedicated mac second parameter is the mac address: aabbccddee. third parameter is the ip address: 01020304. the last three parameters are zero when the notification method is smb alert.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 475 table 5-19. mdef results 5.4 nc-si interface the network controller sideband interface (nc-si) is a dmtf industry standard protocol for the sideband interface. nc-si uses a modified version of the industry standard rmii interface for the physical layer as well as defining a new logical layer. the nc-si specification can be found at the dmtf website at: http://www.dmtf.org/ 5.4.1 overview 5.4.1.1 terminology the terminology in this section is taken directly from the nc-si specification and is as follows: manageability decision filter (mdef) filter 0 1 2 3 4 5 6 7 l2 unicast address and x broadcast and manageability vlan andx ip address and l2 unicast address or broadcast or multicast and arp request or arp response or neighbor discovery or port 0x298 or port 0x26f or flex port 15:0 or flex tco 3:0 or term definition frame versus packet frame is used in reference to ethernet, whereas packet is used everywhere else.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 476 october 2010 external network interface the interface of the network controller that provides connectivity to the external network infrastructure (port). internal host interface the interface of the network controller that provides connectivity to the host os running on the platform. management controller (mc) an intelligent entity comprising of hw/fw/sw, that resides within a platform and is responsible for some or all management functions associated with the platform (bmc, service processor, etc.). network controller (nc) the component within a system that is responsible for providing connectivity to the external ethernet networked world. remote media the capability to allow remote media devices to appear as if they were attached locally to the host. network controller sideband interface the interface of the network controller that provides connectivity to a management controller. it can be shorten to sideband interface as appropriate in the context. term definition interface this refers to the entire physical interface, such as both the transmit and receive interface between the management controller and the network controller. integrated controller the term integrated controller refers to a network controller device that supports two or more channels for nc-si that share a common nc-si physical interface. for example, a network controller that has two or more physical network ports and a single nc-si bus connection. multi-drop multi-drop commonly refers to the case where multiple physical communication devices share an electrically common bus and a single device acts as the master of the bus and communicates with multiple slave or target devices. in nc-si, a management controller serves the role as the master, and the network controllers are the target devices. point-to-point point-to-point commonly refers to the case where only two physical communication devices are interconnected via a physical communication medium. the devices might be in a master/slave relationship, or could be peers. in nc-si, point-to-point operation refers to the situation where only a single management controller and single network controller package are used on the bus in a master/slave relationship where the management controller is the master. channel the control logic and data paths supporting nc-si pass-through operation on a single network interface (port). a network controller that has multiple network interface ports can support an equivalent number of nc-si channels. package one or more nc-si channels in a network controller that share a common set of electrical buffers and common buffer control for the nc-si bus. typically, there will be a single, logical nc-si package for a single physical network controller package (chip or module). however, the specification allows a single physical chip or module to hold multiple nc-si logical packages. control traffic/messages/packets command, response and notification packets transmitted between mc and ncs for the purpose of managing nc-si. pass-through traffic/messages/ packets non-control packets passed between the external network and the mc through the nc. channel arbitration refer to operations where more than one of the network controller channels can be enabled to transmit pass-through packets to the mc at the same time, where arbitration of access to the rxd, crs_dv, and rx_er signal lines is accomplished either by software of hardware means. logically enabled/disabled nc refers to the state of the network controller wherein pass-through traffic is able/unable to flow through the sideband interface to and from the management controller, as a result of issuing enable/disable channel command. nc rx defined as the direction of ingress traffic on the external network controller interface
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 477 5.4.1.2 system topology in nc-si each physical endpoint (nc package) can have several logical slaves (nc channels). nc-si defines that one management controller and up to four network controller packages can be connected to the same nc-si link. figure 5-10 shows an example topology for a single mc and a single nc package. in this example the nc package has two nc channels. figure 5-10. single nc package, two nc channels figure 5-11 shows an example topology for a single mc and two nc packages. in this example, one nc package has two nc channels and the other has only one nc channel. nc tx defined as the direction of egress traffic on the external network controller interface nc-si rx defined as the direction of ingress traffic on the sideband enhanced nc-si interface with respect to the network controller. nc-si tx defined as the direction of egress traffic on the sideband enhanced nc-si interface with respect to the network controller.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 478 october 2010 figure 5-11. two nc packages (left, with two nc channels and right, with one nc channel) scenarios in which the nc-si lines are shard by multiple ncs (as shown in figure 5-11 ) mandate an arbitration mechanism. the arbitration mechanism is described in section 5.4.5.1 . 5.4.1.3 data transport since nc-si uses the rmii transport layer, data is transferred in the form of ethernet frames. nc-si defines two types of frames transmitted on the nc-si interface: 1. control frames: a. frames used to configure and control the interface. b. control frames are identified by a unique ethertype in their l2 header. 2. pass-through frames: a. the actual lan pass-through frames transferred from/to the mc. b. pass-through frames are identified as not being a control frame. c. pass-through frames are attributed to a specific nc channel by their source mac address (as configured in the nc by the mc). 5.4.1.3.1 control frames nc-si control frames are identified by a unique nc-si ethertype (0x88f8). control frames are used in a single-threaded operation, meaning commands are generated only by the mc and can only be sent one at a time. each command from the mc is followed by a single response from the nc (command-response flow), after which the mc is allowed to send a new command. the only exception to the command-response flow is the asynchronous event notification (aen). these control frames are sent unsolicited from the nc to the mc. note: aen functionality by the nc must be disabled by default, until activated by the mc using the enable aen commands.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 479 in order to be considered a valid command, the control frame must: 1. comply with the nc-si header format. 2. be targeted to a valid channel in the package via the package id and channel id fields. for example, to target a nc channel with package id of 0x2 and internal channel id of 0x5, the mc must set the channel id inside the control frame to 0x45. note: channel id is composed of three bits of package id and five bits of internal channel id. 3. contain a correct payload checksum (if used). 4. meet any other condition defined by nc-si. note: there are also commands (such as select package) targeted to the package as a whole. these commands must use an internal channel id of 0x1f. for more details, refer to the nc-si specification. 5.4.1.3.2 nc-si frames receive flow figure 5-12 shows the overall flow for frames received on the nc from the mc. figure 5-12. nc-si frames receive flow for the nc 5.4.2 nc-si support 5.4.2.1 supported features the 82598 supports the all the mandatory features of the nc-si specification. table 5-20 lists the supported commands.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 480 october 2010 table 5-20. supported nc-si commands command supported? clear initial state yes get version id yes get parameters yes get controller packet statistics yes, partially get link status yes enable channel yes disable channel yes reset channel yes enable vlan yes. the 82598 does not support filtering of user priority/cfi bits of vlan disable vlan yes enable broadcast yes disable broadcast yes set mac address yes clear mac address yes get nc-si statistics yes, partially enable nc-si flow-control no disable nc-si flow-control no set link command yes enable global multicast filter yes disable global multicast filter yes get capabilities yes set vlan filters yes aen enable yes get pass-through statistics yes, partially select package yes deselect package yes enable channel network tx yes command supported?
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 481 table 5-21 lists the different capabilities and parameters that are advertised by the 82598 (per each nc-si channel): disable channel network tx yes oem command yes
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 482 october 2010 table 5-21. nc-si capabilities advertisement feature capability details capabilities flags hardware arbitration supported os presence supported network controller to management controller flow control support not supported management controller to network controller flow control support not supported all multicast addresses support supported broadcast filtering arp supported dhcp client supported dhcp server supported netbios supported multicast filtering ipv6 neighbor advertisement supported ipv6 router advertisement supported dhcpv6 relay and server multicast supported buffering capabilities lan receive buffer size 8kbytes aen support all aens are supported mac filtering unicast filters 0 multicast filters 0 mixed filters 2 vlan filtering vlan filters 8 vlan mode support supported modes modes 1 and 3 feature capability details channel count number of channels in the package 2 channels
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 483 table 5-22 lists the optional features supported: version id nc-si version 1.0 fw name the 82598 rom verified fw version 0x20d0002 pci did 0x10a7 pci vid 0x8086 manufacturer id (iana) 0x157 (intel)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 484 october 2010 table 5-22. optional nc-si features support 5.4.2.2 nc-si mode - intel specific commands in addition to the regular nc-si commands, the following intel vendor specific commands are supported. the purpose of these commands is to provide a means for the baseboard management controller (bmc) to access some of the intel-specific features present in the 82598. 5.4.2.2.1 overview the following features are available via the nc-si oem specific command: ? receive filters: ? packet addition decision filters 0x0?0x4 ? packet reduction decision filters 0x5?0x7 ? mng2host register (controls the forwarding of manageability packets to the host) feature supported details aens yes note: the driver state aen might be emitted up to 15 seconds after actual driver change. get controller packet statistics command no get nc-si statistics command yes, partially supports the following counters: 1-4, 7. get nc-si pass-through statistics command yes, partially supports the following counters: 2 support the following counters only when the os is down: 1, 6, 7. vlan modes yes, partially supports only modes 1, 3. mac address filters yes supports two mac addresses as mixed per port. channel count yes supports two channels. vlan filters yes supports eight vlan filters per port. broadcast filters yes supports the following filters: ? arp. ? dhcp. ? netbios. multicast filters yes supports the following filters: ? ipv6 neighbor advertisement. ? ipv6 router advertisement. ? dhcpv6 relay and server multicast. nc-si flow control command no does not support nc-si flow-control. feature supported details hw arbitration no does not support nc-si hw arbitration. allow link down no does not support shutting down the link when disabled.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 485 ? flex 128 filters 0x0?0x3 ? flex tcp/udp port filters 0x0...0xa ? ipv4/ipv6 filters ? get system mac address - this command allows the mc to retrieve the system mac address used by the nc. this mac address can be used for a shared mac address mode. ? keep phy link up ( veto bit) enable/disable - this feature enables the bmc to block phy reset, which might cause session loss. ? tco reset - allows the mc to reset the 82598. ? checksum offloading - offloads ip/udp/tcp checksum checking from the mc. these commands are designed to be compliant with their corresponding smbus commands (if existing). all of the commands are based on a single dmtf defined nc-si command, known as oem command. this command is as follows. 5.4.2.2.1.1 oem command (0x50) the oem command can be used by the mc to request the sideband interface to provide vendor-specific information. the vendor enterprise number (ven) is the unique mib/snmp private enterprise number assigned by iana per organization. vendors are free to define their own internal data structures in the vendor data fields. figure 5-13. oem command packet format 5.4.2.2.1.2 oem response (0xd0) below is the vendor specific format for commands, as defined by nc-si. figure 5-14. oem response packet format
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 486 october 2010 5.4.2.2.1.3 oem specific command response reason codes table 5-23. commands summary response code reason code value description value description 0x1 command failed 0x5081 invalid intel command number 0x1 command failed 0x5082 invalid intel command parameter number 0x1 command failed 0x5085 internal network controller error 0x1 command failed 0x5086 invalid vendor enterprise code intel command parameter command name 0x00 0x00 set ip filters control 0x01 0x00 get ip filters control 0x02 0x0a set manageability to host 0x10 set flexible 128 filter 0 mask and length 0x11 set flexible 128 filter 0 data 0x20 set flexible 128 filter 1 mask and length 0x21 set flexible 128 filter 1 data 0x30 set flexible 128 filter 2 mask and length 0x31 set flexible 128 filter 2 data 0x40 set flexible 128 filter 3 mask and length 0x41 set flexible 128 filter 3 data 0x61 set packet addition filters 0x63 set flex tcp/udp port filters 0x64 set flex ipv4 address filters 0x65 set flex ipv6 address filters 0x3 0x0a get manageability to host 0x10 get flexible 128 filter 0 mask and length 0x11 get flexible 128 filter 0 data 0x20 get flexible 128 filter 1 mask and length 0x21 get flexible 128 filter 1 data
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 487 5.4.2.2.2 proprietary commands format 5.4.2.2.2.1 set intel filters control command (intel command 0x00) 0x30 get flexible 128 filter 2 mask and length 0x31 get flexible 128 filter 2 data 0x40 get flexible 128 filter 3 mask and length 0x41 get flexible 128 filter 3 data 0x61 get packet addition filters 0x63 get flex tcp/udp port filters 0x64 get flex ipv4 address filters 0x65 get flex ipv6 address filters intel command parameter command name 0x04 0x00 set unicast packet reduction 0x01 set multicast packet reduction 0x02 set broadcast packet reduction 0x05 0x00 get unicast packet reduction 0x01 get multicast packet reduction 0x02 get broadcast packet reduction 0x06 n/a get system mac address 0x20 n/a set intel management control 0x21 n/a get intel management control 0x22 n/a perform tco reset 0x23 n/a enable ip/udp/tcp checksum offloading 0x24 n/a disable ip/udp/tcp checksum offloading
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 488 october 2010 5.4.2.2.2.2 set intel filters control response format (intel command 0x00) 5.4.2.2.3 set intel filters control - ip filters control command (intel command 0x00, filter control index 0x00) this command controls different aspects of the intel filters. where ?ip filters control? has the following format: bit # name description default value 0 ipv4/ipv6 mode ipv6 (0b): there are zero ipv4 filters and four ipv6 filters ipv4 (1b): there are four ipv4 filters and three ipv6 filters 1b 1..15 reserved 16 ipv4 filter 0 valid indicates if the ipv4 address configured in ipv4 address 0 is valid. 0b note: the network controller automatically sets this bit to 1b if the set intel filter ? ipv4 filter command is used for filter zero. 17 ipv4 filter 1 valid indicates if the ipv4 address configured in ipv4 address 1 is valid. 0b note: the network controller automatically sets this bit to 1b if the set intel filter ? ipv4 filter command is used for filter one. 18 ipv4 filter 2 valid indicates if the ipv4 address configured in ipv4 address 2 is valid. 0b note: the network controller automatically sets this bit to 1b if the set intel filter ? ipv4 filter command is used for filter two.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 489 5.4.2.2.3.1 set intel filters control - ip filters control response (intel command 0x00, filter control index 0x00) 5.4.2.2.4 get intel filters control command (intel command 0x01) 5.4.2.2.4.1 get intel filters control - ip filters control command (intel command 0x01, filter control index 0x00) this command controls different aspects of the intel filters. 19 ipv4 filter 3 valid indicates if the ipv4 address configured in ipv4 address 3 is valid. 0b note: the network controller automatically sets this bit to 1b if the set intel filter ? ipv4 filter command is used for filter three. 20..23 reserved 24 ipv6 filter 0 valid indicates if the ipv6 address configured in ipv6 address 0 is valid. 0b note: the network controller automatically sets this bit to 1b if the set intel filter ? ipv6 filter command is used for filter zero. bit # name description default value 25 ipv6 filter 1 valid indicates if the ipv6 address configured in ipv6 address 1 is valid. 0b note: the network controller automatically sets this bit to 1b if the set intel filter ? ipv6 filter command is used for filter one. 26 ipv6 filter 2 valid indicates if the ipv6 address configured in ipv6 address 2 is valid. 0b note: the network controller automatically sets this bit to 1b if the set intel filter ? ipv6 filter command is used for filter two. 27 ipv6 filter 3 valid indicates if the ipv6 address configured in ipv6 address 3 is valid. 0b note: the network controller automatically sets this bit to 1b if the set intel filter ? ipv6 filter command is used for filter three. 28..31 reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 490 october 2010 5.4.2.2.4.2 get intel filters control - ip filters control response (intel command 0x01, filter control index 0x00) 5.4.2.2.5 set intel filters formats 5.4.2.2.5.1 set intel filters command (intel command 0x02) 5.4.2.2.5.2 set intel filters response (intel command 0x02)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 491 5.4.2.2.5.3 set intel filters - manageability to host command (intel command 0x02, filter parameter 0x0a) this command sets the mng2host register. the mng2host register controls whether pass-through packets destined to the bmc are also be forwarded to the host os. the mng2host register has the following structure: 5.4.2.2.5.4 set intel filters - manageability to host response (intel command 0x02, filter parameter 0x0a) bits description default 0 decision filter 0 determines if packets that have passed decision filter 0 is also forwarded to the host os. 1 decision filter 1 determines if packets that have passed decision filter 1 is also forwarded to the host os. 2 decision filter 2 determines if packets that have passed decision filter 2 is also forwarded to the host os. 3 decision filter 3 determines if packets that have passed decision filter 3 is also forwarded to the host os. 4 decision filter 4 determines if packets that have passed decision filter 4 is also forwarded to the host os. 5 unicast and mixed determines if broadcast packets are also forwarded to the host os. 6 global multicast determines if unicast and mixed packets are also forwarded to the host os. 7 broadcast determines if global multicast packets are also forwarded to the host os.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 492 october 2010 5.4.2.2.5.5 set intel filters - flex filter 0 enable mask and length command (intel command 0x02, filter parameter 0x10/0x20/0x30/0x40) the following command sets the intel flex filters mask and length. use filter parameters 0x10/0x20/ 0x30/0x40 for flexible filters 0/1/2/3 accordingly. 5.4.2.2.5.6 set intel filters - flex filter 0 enable mask and length response (intel command 0x02, filter parameter 0x10/0x20/0x30/0x40)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 493 5.4.2.2.5.7 set intel filters - flex filter 0 data command (intel command 0x02, filter parameter 0x11/0x21/0x31/0x41) note: using this command to configure the filters data must be done after the flex filter mask command is issued and the mask is set. 5.4.2.2.5.8 set intel filters - flex filter 0 data response (intel command 0x02, filter parameter 0x11/0x21/0x31/0x41) 5.4.2.2.5.9 set intel filters - packet addition decision filter command (intel command 0x02, filter parameter 0x61)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 494 october 2010 filter index range: 0x0..0x4. bit # name description 0 unicast (and) if set, packets must match a unicast filter. 1 broadcast (and) if set, packets must match the broadcast filter. 2 vlan (and) if set, packets must match a vlan filter. 3 ip address (and) if set, packets must match an ip filter. 4 unicast (or) if set, packets must match a unicast filter or a different or filter. 5 broadcast if set, packets must match the broadcast filter or a different or filter. 6 multicast (and) if set, packets must match the multicast filter. 7 arp request (or) if set, packets must match the arp request filter or a different or filter. 8 arp response (or) if set, packets must also match the arp response filter or a different or filter. 9 neighbor discovery (or) if set, packets must also match the neighbor discovery filter or a different or filter. 10 port 0x298 (or) if set, packets must also match a fixed tcp/udp port 0x298 filter or a different or filter. 11 port 0x26f (or) if set, packets must also match a fixed tcp/udp port 0x26f filter or a different or filter. 12 flex port 0 (or) if set, packets must also match the tcp/udp port filter 0 or a different or filter. 13 flex port 1 (or) if set, packets must also match the tcp/udp port filter 1 or a different or filter. 14 flex port 2 (or) if set, packets must also match the tcp/udp port filter 2 or a different or filter. 15 flex port 3 (or) if set, packets must also match the tcp/udp port filter 3 or a different or filter. 16 flex port 4 (or) if set, packets must also match the tcp/udp port filter 4 or a different or filter. 17 flex port 5 (or) if set, packets must also match the tcp/udp port filter 5 or a different or filter. 18 flex port 6 (or) if set, packets must also match the tcp/udp port filter 6 or a different or filter. 19 flex port 7 (or) if set, packets must also match the tcp/udp port filter 7 or a different or filter. 20 flex port 8 (or) if set, packets must also match the tcp/udp port filter 8 or a different or filter. bit # name description 21 flex port 9 (or) if set, packets must also match the tcp/udp port filter 9 or a different or filter. 22 flex port 10 (or) if set, packets must also match the tcp/udp port filter 10 or a different or filter. 23 flex port 11 (or) if set, packets must also match the tcp/udp port filter 11 or a different or filter. 24 reserved 25 reserved
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 495 the filtering is divided into two decisions: ? bits 0, 1, 2, 3, and 6 work in an and manner; they all must be true in order for a packet to pass (if any were set). ? bits 5 and 7-31 work in an or manner; at least one of them must be true for a packet to pass (if any were set). see figure 5-5 for more details on the decision filters. note: these filter settings operate according to the vlan mode, as configured according to the dmtf nc-si specification. after disabling packet reduction filters, the mc must re-set the vlan mode using the set vlan command. 5.4.2.2.5.10 set intel filters - packet addition decision filter response (intel command 0x02, filter parameter 0x61) 5.4.2.2.5.11 set intel filters - flex tcp/udp port filter command (intel command 0x02, filter parameter 0x63) filter index range: 0x0..0xa. 26 reserved 27 reserved 28 flex tco 0 (or) if set, packets must also match the flex 128 tco filter 0 or a different or filter. 29 flex tco 1 (or) if set, packets must also match the flex 128 tco filter 1 or a different or filter. 30 flex tco 2 (or) if set, packets must also match the flex 128 tco filter 2 or a different or filter. 31 flex tco 3 (or) if set, packets must also match the flex 128 tco filter 3 or a different or filter.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 496 october 2010 5.4.2.2.5.12 set intel filters - flex tcp/udp port filter response (intel command 0x02, filter parameter 0x63) 5.4.2.2.5.13 set intel filters - ipv4 filter command (intel command 0x02, filter parameter 0x64) note: the filters index range can vary according to the ipv4/ipv6 mode setting in the filters control command. ipv4 mode: filter index range: 0x0..0x3. ipv6 mode: no ipv4 filters. 5.4.2.2.5.14 set intel filters - ipv4 filter response (intel command 0x02, filter parameter 0x64)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 497 5.4.2.2.5.15 set intel filters - ipv6 filter command (intel command 0x02, filter parameter 0x65) note: the filters index range can vary according to the ipv4/ipv6 mode setting in the filters control command. ipv4 mode: filter index range: 0x0..0x2. ipv6 mode: filter index range: 0x0..0x3.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 498 october 2010 5.4.2.2.5.16 set intel filters - ipv6 filter response (intel command 0x02, filter parameter 0x65) 5.4.2.2.6 get intel filters formats 5.4.2.2.6.1 get intel filters command (intel command 0x03) 5.4.2.2.6.2 get intel filters response (intel command 0x03) 5.4.2.2.6.3 get intel filters - manageability to host command (intel command 0x03, filter parameter 0x0a) this command retrieves the mng2host register. the mng2host register controls whether pass-through packets destined to the bmc are also be forwarded to the host os.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 499 5.4.2.2.6.4 get intel filters - manageability to host response (intel command 0x03, filter parameter 0x0a) the mng2host register has the following structure: 5.4.2.2.6.5 get intel filters - flex filter 0 enable mask and length command (intel command 0x03, filter parameter 0x10/0x20/0x30/0x40) the following command retrieves the intel flex filters mask and length. use filter parameters 0x10/ 0x20/0x30/0x40 for flexible filters 0/1/2/3 accordingly. bits description default 0 decision filter 0 determines if packets that have passed decision filter 0 are also forwarded to the host os. 1 decision filter 1 determines if packets that have passed decision filter 1 are also forwarded to the host os. 2 decision filter 2 determines if packets that have passed decision filter 2 are also forwarded to the host os. 3 decision filter 3 determines if packets that have passed decision filter 3 are also forwarded to the host os. 4 decision filter 4 determines if packets that have passed decision filter 4 are also forwarded to the host os. 5 unicast and mixed determines if broadcast packets are also forwarded to the host os. 6 global multicast determines if unicast packets are also forwarded to the host os. 7 broadcast determines if multicast packets are also forwarded to the host os.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 500 october 2010 5.4.2.2.6.6 get intel filters - flex filter 0 enable mask and length response (intel command 0x03, filter parameter 0x10/0x20/0x30/0x40) 5.4.2.2.6.7 get intel filters - flex filter 0 data command (intel command 0x03, filter parameter 0x11/0x21/0x31/0x41) the following command retrieves the intel flex filters data. use filter parameters 0x11/0x21/0x31/0x41 for flexible filters 0/1/2/3 accordingly.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 501 5.4.2.2.6.8 get intel filters - flex filter 0 data response (intel command 0x03, filter parameter 0x11) 5.4.2.2.6.9 get intel filters - packet addition decision filter command (intel command 0x03, filter parameter 0x61) filter index range: 0x0..0x4.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 502 october 2010 5.4.2.2.6.10 get intel filters - packet addition decision filter response (intel command 0x03, filter parameter 0x0a) 5.4.2.2.6.11 get intel filters - flex tcp/udp port filter command (intel command 0x03, filter parameter 0x63) filter index range: 0x0..0xa. 5.4.2.2.6.12 get intel filters - flex tcp/udp port filter response (intel command 0x03, filter parameter 0x63) filter index range: 0x0..0xa.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 503 5.4.2.2.6.13 get intel filters - ipv4 filter command (intel command 0x03, filter parameter 0x64) note: the filters index range can vary according to the ipv4/ipv6 mode setting in the filters control command. ipv4 mode: filter index range: 0x0..0x3. ipv6 mode: no ipv4 filters. 5.4.2.2.6.14 get intel filters - ipv4 filter response (intel command 0x03, filter parameter 0x64) 5.4.2.2.6.15 get intel filters - ipv6 filter command (intel command 0x03, filter parameter 0x65) note: the filters index range can vary according to the ipv4/ipv6 mode setting in the filters control command ipv4 mode: filter index range: 0x0..0x2. ipv6 mode: filter index range: 0x0..0x3.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 504 october 2010 5.4.2.2.6.16 get intel filters - ipv6 filter response (intel command 0x03, filter parameter 0x65) 5.4.2.2.7 set intel packet reduction filters formats 5.4.2.2.7.1 set intel packet reduction filters command (intel command 0x04) 5.4.2.2.7.2 set intel packet reduction filters response (intel command 0x04)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 505 5.4.2.2.7.3 set unicast packet reduction command (intel command 0x04, reduction filter index 0x00) this command causes the nc to filter packets that have passed due to the unicast filter (mac address filters, as specified in the dmtf nc-si). note that unicast filtering might be affected by other filters, as specified in the dmtf nc-si. the filtering of these packets are done such that the mc might add a logical condition that a packet must match, or it must be discarded. note: packets that might have been blocked can still pass due to other decision filters. in order to disable unicast packet reduction, the mc should set all reduction filters to 0b. following such a setting the nc must forward, to the mc, all packets that have passed the unicast filters (mac address filtering) as specified in the dmtf nc-si. the unicast packet reduction field has the following structure: bit # name description 0 reserved 1 reserved 2 reserved 3 ip address if set, all unicast packets must also match an ip filter. 4 reserved 5 reserved 6 reserved 7 reserved 8 arp response if set, all unicast packets must also match the arp response filter (any of the active filters). 9 reserved 10 port 0x298 if set, all unicast packets must also match a fixed tcp/udp port 0x298 filter. 11 port 0x26f if set, all unicast packets must also match a fixed tcp/udp port 0x26f filter. 12 flex port 0 if set, all unicast packets must also match the tcp/udp port filter 0. 13 flex port 1 if set, all unicast packets must also match the tcp/udp port filter 1. 14 flex port 2 if set, all unicast packets must also match the tcp/udp port filter 2. 15 flex port 3 if set, all unicast packets must also match the tcp/udp port filter 3. 16 flex port 4 if set, all unicast packets must also match the tcp/udp port filter 4. 17 flex port 5 if set, all unicast packets must also match the tcp/udp port filter 5. 18 flex port 6 if set, all unicast packets must also match the tcp/udp port filter 6. bit # name description
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 506 october 2010 the filtering is divided into two decisions: ? bit 3 works in an and manner; it must be true in order for a packet to pass (if was set). ? bits 8-31 work in an or manner; at least one of them must be true for a packet to pass (if any were set). see figure 5-5 for more details on the decision filters. 19 flex port 7 if set, all unicast packets must also match the tcp/udp port filter 7. 20 flex port 8 if set, all unicast packets must also match the tcp/udp port filter 8. 21 flex port 9 if set, all unicast packets must also match the tcp/udp port filter 9. 22 flex port 10 if set, all unicast packets must also match the tcp/udp port filter 10. 23 reserved 24 reserved 25 reserved 26 reserved 27 reserved 28 flex tco 0 if set, all unicast packets must also match the flex 128 tco filter 0. 29 flex tco 1 if set, all unicast packets must also match the flex 128 tco filter 1. 30 flex tco 2 if set, all unicast packets must also match the flex 128 tco filter 2. 31 flex tco 3 if set, all unicast packets must also match the flex 128 tco filter 3.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 507 5.4.2.2.7.4 set unicast packet reduction response (intel command 0x04, reduction filter index 0x00) 5.4.2.2.7.5 set multicast packet reduction command (intel command 0x04, reduction filter index 0x01) this command causes the nc to filter packets that have passed due to the multicast filter (mac address filters, as specified in the dmtf nc-si). the filtering of these packets are done such that the mc might add a logical condition that a packet must match, or it must be discarded. note: packets that might have been blocked can still pass due to other decision filters. in order to disable mulitcast packet reduction, the mc should set all reduction filters to 0b. following such a setting, the nc must forward, to the mc, all packets that have passed the multicast filters (global multicast filtering) as specified in the dmtf nc-si. the multicast packet reduction field has the following structure: bit # name description 0 reserved reserved. 1 reserved 2 reserved 3 ip address if set, all multicast packets must also match an ip filter. 4 reserved 5 reserved 6 reserved 7 reserved 8 arp response if set, all multicast packets must also match the arp response filter (any of the active filters). 9 reserved 10 port 0x298 if set, all multicast packets must also match a fixed tcp/udp port 0x298 filter. bit # name description
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 508 october 2010 the filtering is divided into two decisions: bit 3 works in an and manner; it must be true in order for a packet to pass (if was set). bits 4, 5, and 7-31 work in an or manner; at least one of them must be true for a packet to pass (if any were set). see figure 5-5 for more details on the decision filters. 11 port 0x26f if set, all multicast packets must also match a fixed tcp/udp port 0x26f filter. 12 flex port 0 if set, all multicast packets must also match the tcp/udp port filter 0. 13 flex port 1 if set, all multicast packets must also match the tcp/udp port filter 1. 14 flex port 2 if set, all multicast packets must also match the tcp/udp port filter 2. 15 flex port 3 if set, all multicast packets must also match the tcp/udp port filter 3. 16 flex port 4 if set, all multicast packets must also match the tcp/udp port filter 4. 17 flex port 5 if set, all multicast packets must also match the tcp/udp port filter 5. 18 flex port 6 if set, all multicast packets must also match the tcp/udp port filter 6. 19 flex port 7 if set, all multicast packets must also match the tcp/udp port filter 7. 20 flex port 8 if set, all multicast packets must also match the tcp/udp port filter 8. 21 flex port 9 if set, all multicast packets must also match the tcp/udp port filter 9. 22 flex port 10 if set, all multicast packets must also match the tcp/udp port filter 10. 23 reserved 24 reserved 25 reserved 26 reserved 27 reserved 28 flex tco 0 if set, all multicast packets must also match the flex 128 tco filter 0. 29 flex tco 0 if set, all multicast packets must also match the flex 128 tco filter 1. 30 flex tco 0 if set, all multicast packets must also match the flex 128 tco filter 2. 31 flex tco 0 if set, all multicast packets must also match the flex 128 tco filter 3.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 509 5.4.2.2.7.6 set multicast packet reduction response (intel command 0x04, reduction filter index 0x01) 5.4.2.2.7.7 set broadcast packet reduction command (intel command 0x04, reduction filter index 0x02) this command causes the nc to filter packets that have passed due to the broadcast filter (mac address filters, as specified in the dmtf nc-si). the filtering of these packets are done such that the mc might add a logical condition that a packet must match, or it must be discarded. note: packets that might have been blocked can still pass due to other decision filters. in order to disable broadcast packet reduction, the mc should set all reduction filters to 0b. following such a setting, the nc must forward, to the mc, all packets that have passed the broadcast filters as specified in the dmtf nc-si. the broadcast packet reduction field has the following structure: bit # name description 0 reserved reserved. 1 reserved 2 reserved 3 ip address if set, all broadcast packets must also match an ip filter. 4 reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 510 october 2010 the filtering is divided into two decisions: bit 3 works in an and manner; it must be true in order for a packet to pass (if was set). bits 4, 5, and 7-31 work in an or manner; at least one of them must be true for a packet to pass (if any were set). 5 reserved 6 reserved 7 reserved 8 arp response if set, all broadcast packets must also match the arp response filter (any of the active filters). 9 reserved 10 port 0x298 if set, all broadcast packets must also match a fixed tcp/udp port 0x298 filter. 11 port 0x26f if set, all broadcast packets must also match a fixed tcp/udp port 0x26f filter. 12 flex port 0 if set, all broadcast packets must also match the tcp/udp port filter 0. 13 flex port 1 if set, all broadcast packets must also match the tcp/udp port filter 1. 14 flex port 2 if set, all broadcast packets must also match the tcp/udp port filter 2. 15 flex port 3 if set, all broadcast packets must also match the tcp/udp port filter 3. 16 flex port 4 if set, all broadcast packets must also match the tcp/udp port filter 4. 17 flex port 5 if set, all broadcast packets must also match the tcp/udp port filter 5. 18 flex port 6 if set, all broadcast packets must also match the tcp/udp port filter 6. 19 flex port 7 if set, all broadcast packets must also match the tcp/udp port filter 7. 20 flex port 8 if set, all broadcast packets must also match the tcp/udp port filter 8. 21 flex port 9 if set, all broadcast packets must also match the tcp/udp port filter 9. 22 flex port 10 if set, all broadcast packets must also match the tcp/udp port filter 10. 23 reserved 24 reserved 25 reserved 26 reserved 27 reserved 28 flex tco 0 if set, all broadcast packets must also match the flex 128 tco filter 0. 29 flex tco 0 if set, all broadcast packets must also match the flex 128 tco filter 1. 30 flex tco 0 if set, all broadcast packets must also match the flex 128 tco filter 2. 31 flex tco 0 if set, all broadcast packets must also match the flex 128 tco filter 3.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 511 see figure 5-5 for more details on the decision filters. 5.4.2.2.7.8 set broadcast packet reduction response (intel command 0x08) 5.4.2.2.8 get intel packet reduction filters formats 5.4.2.2.8.1 get intel packet reduction filters command (intel command 0x05)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 512 october 2010 5.4.2.2.8.2 set intel packet reduction filters response (intel command 0x05) 5.4.2.2.8.3 get unicast packet reduction command (intel command 0x05, reduction filter index 0x00) this command causes the nc to disable any packet reductions for unicast address filtering. 5.4.2.2.8.4 get unicast packet reduction response (intel command 0x05, reduction filter index 0x00)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 513 5.4.2.2.8.5 get multicast packet reduction command (intel command 0x05, reduction filter index 0x01) 5.4.2.2.8.6 get multicast packet reduction response (intel command 0x05, reduction filter index 0x01) 5.4.2.2.8.7 get broadcast packet reduction command (intel command 0x05, reduction filter index 0x02)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 514 october 2010 5.4.2.2.8.8 get broadcast packet reduction response (intel command 0x05, reduction filter index 0x02) 5.4.2.2.9 system mac address 5.4.2.2.9.1 get system mac address command (intel command 0x06) in order to support a system configuration that requires the nc to hold the mac address for the mc (such as shared mac address mode), the following command is provided to enable the mc to query the nc for a valid mac address. the nc must return the system mac addresses. the mc should use the returned mac addressing as a shared mac address by setting it using the set mac address command as defined in nc-si 1.0. it is also recommended that the mc use packet reduction and manageability-to-host command to set the proper filtering method. 5.4.2.2.9.2 get system mac address response (intel command 0x06)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 515 5.4.2.2.10 set intel management control formats 5.4.2.2.10.1 set intel management control command (intel command 0x20) where: intel management control 1 is as follows: 5.4.2.2.10.2 set intel management control response (intel command 0x20) bit # default value description 00b enable critical session mode (keep phy link up and veto bit) 0b - disabled 1b - enabled when critical session mode is enabled, the following behaviors are disabled: ? the phy is not reset on pe_rst# and pcie* resets (in-band and link drop). other reset events are not affected - internal_power_on_reset, device disable, force tco, and phy reset by software. ? the phy does not change its power state. as a result link speed does not change. ? the device does not initiate configuration of the phy to avoid losing link. 1?7 0x0 reserved
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 516 october 2010 5.4.2.2.11 get intel management control formats 5.4.2.2.11.1 get intel management control command (intel command 0x21) where: intel management control 1 is as described in section 5.4.2.2.10.2 . 5.4.2.2.11.2 get intel management control response (intel command 0x21) 5.4.2.2.12 tco reset this command causes the nc to perform tco reset, if force tco reset is enabled in the eeprom. if the bmc has detected that the os is hung and has blocked the rx/tx path, the force tco reset clears the data-path (rx/tx) of the nc to enable the bmc to transmit/receive packets through the nc. when this command is issued to a channel in a package, it applies only to the specific channel. after successfully performing the command, the nc considers the force tco command as an indication that the os is hung and clears the drv_load flag (disable the lan device driver). 5.4.2.2.12.1 perform intel tco reset command (intel command 0x22)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 517 5.4.2.2.12.2 perform intel tco reset response (intel command 0x22) 5.4.2.2.13 checksum offloading this command enables the checksum offloading filters in the nc. when enabled, these filters block any packets that did not pass ip, udp and tcp checksums from being forwarded to the mc. 5.4.2.2.13.1 enable checksum offloading command (intel command 0x23) 5.4.2.2.13.2 enable checksum offloading response (intel command 0x23)
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 518 october 2010 5.4.2.2.13.3 disable checksum offloading command (intel command 0x24) 5.4.2.2.13.4 disable checksum offloading response (intel command 0x24) 5.4.3 basic nc-si workflows 5.4.3.1 package states a nc package can be in one of the following two states: 1. selected - in this state, the package is allowed to use the nc-si lines, meaning the nc package might send data to the bmc. 2. de-selected - in this state, the package is not allowed to use the nc-si lines, meaning, the nc package cannot send data to the bmc. also note that the mc must select no more than one nc package at any given time. package selection can be accomplished in one of two methods: 1. select package command - this command explicitly selects the nc package. 2. any other command targeted to a channel in the package also implicitly selects that nc package. package de-select can be accomplished only by issuing the de-select package command. note: the mc should always issue the select package command as the first command to the package before issuing channel-specific commands. for further details on package selection, refer to the nc-si specification. 5.4.3.2 channel states a nc channel can be in one of the following states:
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 519 1. initial state - in this state, the channel only accepts the clear initial state command (the package also accepts the select package and de-select package commands). 2. active state - this is the normal operational mode. all commands are accepted. for normal operation mode, the mc should always send the clear initial state command as the first command to the channel. 5.4.3.3 discovery after interface power-up, the mc should perform a discovery process to discover the ncs that are connected to it. this process should include an algorithm similar to the following: 1. for package_id=0x0 to max_package_id a. issue select package command to package id package_id b. if received a response then for internal_channel_id = 0x0 to max_internal_channel_id issue a clear initial state command for package_id | internal_channel_id (the combination of package_id and internal_channel_id to create the channel id). if a response was received then consider internal_channel_id as a valid channel for the package_id package the mc can now optionally discover channel capabilities and version id for the channel else (if not a response was not received, then issue a clear initial state command three times. issue a de-select package command to the package (and continue to the next package). c. else (if a response was not received, issue a select packet command three times. 5.4.3.4 configurations this section details different configurations that should be performed by the mc. it is considered a good practice that the mc does not consider any configuration valid unless the mc has explicitly configured it after every reset (entry into the initial state). as a result, it is recommended that the mc re-configure everything at power-up and channel/package resets. 5.4.3.4.1 nc capabilities advertisement nc-si defines the get capabilities command. it is recommended that the mc use this command and verify that the capabilities match its requirements before performing any configurations. for example, the mc should verify that the nc supports a specific aen before enabling it. 5.4.3.4.2 receive filtering in order to receive traffic, the mc must configure the nc with receive filtering rules. these rules are checked on every packet received on the lan interface (such as from the network). only if the rules matched, will the packet be forwarded to the mc.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 520 october 2010 5.4.3.4.2.1 mac address filtering nc-si defines three types of mac address filters: unicast, multicast and broadcast. to be received (not dropped) a packet must match at least one of these filters. note: the mc should set one mac address using the set mac address command and enable broadcast and global multicast filtering. unicast/exact match (set mac address command) this filter filters on specific 48-bit mac addresses. the mc must configure this filter with a dedicated mac address. note: the nc might expose three types of unicast/exact match filters (such as mac filters that match on the entire 48 bits of the mac address): unicast, multicast and mixed. the 82598 exposes two mixed filters, which might be used both for unicast and multicast filtering. the mc should use one mixed filter for its mac address. refer to nc-si specification - set mac address for further details. broadcast (enable/disable broadcast filter command) nc-si defines a broadcast filtering mechanism which has the following states: 1. enabled - all broadcast traffic is blocked (not forwarded) to the mc, except for specific filters (such as arp request, dhcp, and netbios). 2. disabled - all broadcast traffic is forwarded to the mc, with no exceptions. note: refer to nc-si specification enable/disable broadcast filter command. global multicast (enable/disable global multicast filter) nc-si defines a multicast filtering mechanism which has the following states: 1. enabled - all multicast traffic is blocked (not forwarded) to the mc. 2. disabled - all multicast traffic is forwarded to the mc, with no exceptions. the recommended operational mode is enabled, with specific filters set. note: not all multicast filtering modes are necessarily supported. refer to nc-si specification enable/disable global multicast filter command for further details. 5.4.3.4.2.2 vlan nc-si defines the following vlan work modes: mode command and name descriptions disabled disable vlan command in this mode, no vlan frames are received. enabled #1 enable vlan command with vlan only in this mode, only packets that matched a vlan filter are forwarded to the mc. enabled #2 enable vlan command with vlan only + non-vlan in this mode, packets from mode 1 + non-vlan packets are forwarded. enabled #3 enable vlan command with any-vlan + non-vlan in this mode, packets are forwarded regardless of their vlan state.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 521 refer to nc-si specification - enable vlan command for further details. the 82598 only supports modes #1 and #3. recommendation: 1. modes: a. if vlan is not required - use the disabled mode. b. if vlan is required - use the enabled #1 mode. 2. if enabling vlan, the mc should also set the active vlan id filters using the nc-si set vlan filter command prior to setting the vlan mode. 5.4.3.5 pass-through traffic states the mc has independent, separate controls for enablement states of the receive (from lan) and of the transmit (to lan) pass-through paths. 5.4.3.5.1 channel enable this mode controls the state of the receive path: 1. disabled: the channel does not pass any traffic from the network to the mc. 2. enabled: the channel passes any traffic from the network (that matched the configured filters) to the mc. note: this state also affects aens: aens is only sent in the enabled state. note: the default state is disabled. note: it is recommended that the mc complete all filtering configuration before enabling the channel. 5.4.3.5.2 network transmit enable this mode controls the state of the transmit path: 1. disabled - the channel does not pass any traffic from the mc to the network. 2. enabled - the channel passes any traffic from the mc (that matched the source mac address filters) to the network. note: the default state is disabled. note: the nc filters pass-through packets according to their source mac address. the nc tries to match that source mac address to one of the mac addresses configured by the set mac address command. as a result, the mc should enable network transmit only after configuring the mac address. note: it is recommended that the mc complete all filtering configuration (especially mac addresses) before enabling the network transmit. note: this feature can be used for fail-over scenarios. see section 5.4.5.3 . 5.4.3.6 asynchronous event notifications the asynchronous event notifications are unsolicited messages sent from the nc to the mc to report status changes (such as link change, os state change, etc.).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 522 october 2010 recommendations: ? the mc firmware designer should use aens. to do so, the designer must take into account the possibility that a nc-si response frame (such as a frame with the nc-si ethertype), arrives out- of-context (not immediately after a command, but rather after an out-of-context aen). ? to enable aens, the mc should first query which aens are supported, using the get capabilities command, then enable desired aen(s) using the enable aen command, and only then enable the channel using the enable channel command. 5.4.3.7 querying active parameters the mc can use the get parameters command to query the current status of the operational parameters. 5.4.4 resets in nc-si there are two types of resets defined: 1. synchronous entry into the initial state. 2. asynchronous entry into the initial state. recommendations: ? it is very important that the mc firmware designer keep in mind that following any type of reset, all configurations are considered as lost and thus the mc must re-configure everything. ? as an asynchronous entry into the initial state might not be reported and/or explicitly noticed, the mc should periodically poll the nc with nc-si commands (such as get version id, get parameters, etc.) to verify that the channel is not in the initial state. should the nc channel respond to the command with a clear initial state command expected reason code - the mc should consider the channel (and most probably the entire nc package) as if it underwent a (possibly unexpected) reset event. thus, the mc should re-configure the nc. see the nc-si specification section on detecting pass-through traffic interruption. ? the intel recommended polling interval is 2-3 seconds. for exact details on the resets, refer to nc-si specification. 5.4.5 advanced workflows 5.4.5.1 multi-nc arbitration as described in section 5.4.1.2 , in a multi-nc environment, there is a need to arbitrate the nc-si lines. figure 5-15 shows the system topology of such an environment.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 523 figure 5-15. multi-nc environment see figure 5-15 . the nc-si rx lines are shared between the ncs. to enable sharing of the nc-si rx lines, nc-si has defined an arbitration scheme. the arbitration scheme mandates that only one nc package can use the nc-si rx lines at any given time. the nc package that is allowed to use these lines is defined as selected. all the other nc packages are de-selected. nc-si has defined two mechanisms for the arbitration scheme: 1. package selection by the mc. in this mechanism, the mc is responsible for arbitrating between the packages by issuing nc-si commands (select/de-select package). the mc is responsible for having only one package selected at any given time. 2. hw arbitration. in this mechanism, two additional pins on each nc package are used to synchronize the nc package. each nc package has an arb_in and arb_out line and these lines are used to transfer tokens. a nc package that has a token is considered selected. note: hardware arbitration is enabled by default after interface power-up. note: the 82598 does not support hardware arbitration. for further details, refer to section 4 in the nc-si specification. 5.4.5.1.1 package selection sequence example following is an example work flow for a mc and occurs after the discovery, initialization, and configuration. assuming the mc needs to share the nc-si bus between packages the mc should: 1. define a time-slot for each device. 2. discover, initialize, and configure all the nc packages and channels. 3. issue a de-select package command to all the channels. 4. set active_package to 0x0 (or the lowest existing package id).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 524 october 2010 5. at the beginning of each time slot the mc should: a. issue a de-select package to the active_package. the mc must then wait for a response and then an additional timeout for the package to become de-selected (200 ? s). see the nc-si specification table 10 - parameter nc deselect to hi-z interval. b. find the next available package (typically active_package = active_package + 1). c. issue a select package command to active_package. 5.4.5.2 external link control the mc can use the nc-si set link command to control the external interface link settings. this command enables the mc to set the auto-negotiation, link speed, duplex, and other parameters. this command is only available when the host os is not present. indicating the host os status can be obtained via the get link status command and/or host os status change aen command. recommendation: ? unless explicitly needed, it is not recommended to use this feature. the nc-si set link command does not expose all the possible link settings and/or features. this might cause issues under different scenarios. even if decided to use this feature, it is recommended to use it only if the link is down (trust the 82598 until proven otherwise). ? it is recommended that the mc first query the link status using the get link status command. the mc should then use this data as a basis and change only the needed parameters when issuing the set link command. for further details, refer to the nc-si specification. 5.4.5.2.1 set link while lan pcie functionality is disabled in cases where a lan device is used solely for manageability and its lan pcie function is disabled, using the nc-si set link command while advertising multiple speeds and enabling auto-negotiation results in the lowest possible speed chosen. to enable link of higher a speed, the mc should not advertise speeds that are below the desired link speed, as the lowest advertised link speed is chosen. when the lan device is only used for manageability and the link speed advertisement is configured by the mc, changes in the power state of the lan device is not effected and the link speed is not re- negotiated by the lan device. 5.4.5.3 multiple channels (fail-over) in order to support a fail-over scenario, it is required from the mc to operate two or more channels. these channels might or might not be in the same package. the key element of a fault-tolerance fail-over scenario is having two (or more) channels identifying to the switch with the same mac address, but only one of them being active at any given time (such as switching the mac address between channels). to accomplish this, nc-si provides the following: 1. enable network tx command. this command enables shutting off the network transmit path of a specific channel. this enables the mc to configure all the participating channels with the same mac address but only enable one of them. 2. link status change aen or get link status command.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 525 5.4.5.3.1 fail-over algorithm example following is a sample workflow for a fail-over scenario for the 82598 dual-port gbe controller (one package and two channels). 1. mc initializes and configures both channels after power-up. however, the mc uses the same mac address for both of the channels. 2. the mc queries the link status of all the participating channels. the mc should continuously monitor the link status of these channels. this can be accomplished by listening to aens (if used) and/or periodically polling using the get link status command. 3. the mc then only enables channel 0 for network transmission. 4. the mc then issues a gratuitous arp (or any other packet with its source mac address) to the network. this packet informs the switch that this specific mac address is registered to channel 0's specific lan port. 5. the mc begins normal workflow. 6. should the mc receive an indication (aen or polling) that the link status for the active channel (channel 0) has changed, the mc should: a. disable channel0 for network transmission. b. check if a different channel is available (link is up). if found: enable network tx for that specific channel. issue a gratuitous arp (or any other packet with its source mac address) to the network. this packet informs the switch that this specific mac address is registered to channel 0's specific lan port. resume normal workflow. if not found, report the error and continue polling until a valid channel is found. note: the above algorithm can be generalized such that the start-up and normal workflow are the same. in addition, the mc might need to use a specific channel (such as channel 0). in this case, the mc should switch the network transmit to that specific channel as soon as that channel becomes valid (link is up). recommendations: ? it is recommended to wait a link-down-tolerance timeout before a channel is considered invalid. for example, a link re-negotiation might take a few seconds (normally 2 to 3 or might be up to 9). thus, the link must be re-established after a short time. ? typically, this timeout is recommended to be three seconds. ? even when enabling and using aens, it is still recommended to periodically poll the link status, as dropped aens might not be detected. 5.4.5.4 statistics the mc might use the statistics commands as defined in nc-si. these counters are meant mostly for debug purposes and are not all supported. the statistics are divided into three commands:
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 526 october 2010 1. controller statistics - these are statistics on the primary interface (to the host os). see the nc-si specification for details. 2. nc-si statistics - these are statistics on the nc-si control frames (such as commands, responses, aens, etc.). see the nc-si specification for details. 3. nc-si pass-through statistics - these are statistics on the nc-si pass-through frames. see the nc- si specification for details.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 527 6 mechanical specification this section describes the 82598 physical characteristics. 6.1 package information the controller is a 883-lead flip-chip ball grid array (fc-bga) measuring 31 mm by 31 mm. the nominal ball pitch is 1 mm. note: empty spots in the following mechanical pin diagram are correct.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 528 october 2010 figure 6-1. mechanical specifications no solder balls attached to these locations (registrati on marks only)
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 529 7 electrical specifications 7.1 operating conditions this chapter describes 82598 dc and ac (timing) electrical characteristics. this includes maximum rating, recommended operating conditions, power sequencing requirements, and dc and ac timing specifications. dc and ac characteristics include generic digital 3.3 v dc io specification, as well as other specifications supported by the device. 7.2 absolute maximum ratings table 7-1. absolute maximum ratings symbol parameter min max units t case case temperature under bias 0 105 ? c t storage storage temperature range -65 140 ? c vi/vo 3.3 v dc compatible i/os voltage analog 1.2 i/o voltage analog 1.8 i/o voltage vss-0.5 vss?0.2 vss-0.3 4.60 1.68 2.52 v dc vcc3p3 3.3 v dc periphery dc supply voltage vss -0.5 4.60 v dc vcc1p8 1.8 v dc analog dc supply voltage vss-0.3 2.52 v dc vcc1p2 1.2 v dc core/analog dc supply voltage vss-0.2 1.68 v dc note: ratings in this table are those beyond which permanent device damage is likely to occur. these values should not be used as the limits for normal device operation. exposure to absolute maximum rating conditions for extended periods may affect device reliability. recommended operation conditions require accuracy of power supply of +/-5% relative to the nominal voltage vi/vo of 3.3 v dc compatible i/os maximum should be the minimum of 4.6 v dc or (vcc3p3+0.5).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 530 october 2010 7.3 recommended operating conditions table 7-2. recommended operating conditions 7.4 power delivery 7.4.1 power supply specifications table 7-3. 3.3 v dc supply voltage requirements symbol parameter min max units t a operating temperature range commercial (ambient, 0 cfs airflow) 055 c note: for normal device operation, adhere to the limits in this table. sustained operations of a device at conditions exceeding these values, even if within the absolute maximum rating limits, may result in permanent device damage or impaired device reliability. device functionality to stated dc and ac limits is not guaranteed if conditions exceed recommended operating conditions. recommended operation conditions require a power supply accuracy of +/-5%, relative to the nominal voltage. external heat sink (ehs) needed. parameters description min max units rise time time from 10% to 90% mark 0.1 100 ms monotonicity voltage dip allowed in ramp n/a 0 mv slope ramp rate at any given time between 10% and 90% min: 0.8*v(min)/rise time (max) max: 0.8*v(max)/rise time (min) 24 28800 v/s operational range voltage range for normal operating conditions 3 3.6 v dc ripple maximum voltage ripple (peak to peak) n/a 70 mv overshoot maximum overshoot allowed n/a 100 mv overshoot settling time maximum overshoot allowed duration. (at that time delta voltage should be lower than 5mv from steady state voltage) n/a 0.05 ms suggested decoupling capacitance capacitance range 20 47 ? f capacitance esr equivalent series resistance of output capacitance n/a 50 m ?
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 531 table 7-4. 1.8 v dc supply voltage requirements parameters description min max units rise time time from 10% to 90% mark 0.1 100 ms monotonicity voltage dip allowed in ramp n/a 0 mv slope ramp rate at any given time between 10% and 90% min: 0.8*v(min)/rise time (max) max: 0.8*v(max)/rise time (min) 14 15000 v/s operational range voltage range for normal operating conditions 1.71 1.89 v dc ripple maximum voltage ripple (peak to peak) n/a 40 mv overshoot maximum overshoot allowed n/a 100 mv overshoot settling time maximum overshoot allowed duration. (at that time delta voltage should be lower than 5mv from steady state voltage) n/a 0.1 ms suggested decoupling capacitance capacitance range 50 75 f capacitance esr equivalent series resistance of output capacitance n/a 50 m ?
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 532 october 2010 table 7-5. 1.2 v dc supply voltage requirements 7.4.2 power supply sequencing the following relationships between rise times of different power supplies should be maintained to avoid risk of either latch-up or forward-biased internal diodes: (t 3.3 v dc supply < t 1.8 v dc supply ) and (t 3.3 v dc supply < t 1.2 v dc supply ) (1.8 v dc supply < 3.3 v dc supply) and (1.2 v dc supply < 3.3 v dc supply) on power-on, after 3.3 v dc reaches 10% of its final value, voltage rails of 1.8 v dc and 1.2 v dc are allowed 100 ms (t 3_18 ) to reach final operating values. to keep current leakage at a minimum, turn the rails on almost simultaneously. see figure 7-1 for the relationship requirements (between 1.8 v dc and 1.2 v dc power supplies). for the fastest 1.2 v dc ramp: the v 1.2_1.8 parameter value (maximum voltage difference) should be less than 0.3 v dc. for the slowest 1.2 v dc ramp: the t 1.2_1.8 parameter value (maximum time difference), for below the 0.4 v dc level, should be less than 500 ? s. for power-down, turn off all rails at the same time and leave voltage to decay. parameter description min max units rise time time from 10% to 90% mark 0.1 100 ms monotonicity voltage dip allowed in ramp n/a 0 mv slope ramp rate at any given time between 10% and 90% min: 0.8*v(min)/rise time (max) max: 0.8*v(max)/rise time (min) 9.1 10000 v/s operational range voltage range for normal operating conditions 1.14 1.26 v dc ripple maximum voltage ripple (peak to peak) n/a 40 mv overshoot maximum overshoot allowed n/a 100 mv overshoot duration maximum overshoot allowed duration. (at that time delta voltage should be lower than 5mv from steady state voltage) 0.0 0.05 ms suggested decoupling capacitance capacitance range 150 175 f capacitance esr equivalent series resistance of output capacitance 550 m ?
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 533 table 7-6. power sequencing figure notes: ? if vcc1p2 (1.2 v dc) leading (fastest) vcc1p8 (1.8 vdc), vcc1p2 (1.2 v dc) must not be more than 0.3 v dc maximum voltage difference. ? if vcc1p2 (1.2 v dc) lagging (slowest) vcc1p8 (1.8 vdc), vcc1p2 (1.2 v dc) must not lag vcc1p8 (1.8 v dc) by more than 0.5 ms maximum (measured at 0.4 v dc). symbol parameter min max units t 3_1.8 vcc3p3 (3.3 v dc) stable to vcc1p8 (1.8 v dc) stable 0.01 100 ms v 1.2_1.8 vcc1p2 (1.2 v dc) to vcc1p8 (1.8 v dc) ramp difference - fastest 1 1. if board designers have difficulty meeting this parameter, use the lan_pwr_good (external) timing parameter instead (see section 7.6.6.1 ). 0 0.3 v t 1.8_1.2 vcc1p8 (1.8 v dc) to vcc1p2 (1.2 v dc) - slowest 1,2 2. measured at a level of 0.4 v dc. n/a 0.5 ms t 3_1.2 vcc3p3 (3.3 v dc) stable to vcc1p2 (1.2 v dc) stable 0.01 100.5 ms figure 7-1. ramp: 1.8 v dc and 1.2 v dc relationship fastest 1.2v ramp slowest 1.2v ramp v t 1.2v 1.8v 0.4v v 1.2_1.8 t 1.2_1.8
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 534 october 2010 7.4.3 power consumption the following tables show targets for device power. the numbers below apply to device current and power and do not include power losses on external components. other than tdp, assume typical temperature, silicon, and vcc. table 7-7. power consumption ? dual-port ? d0 ? active link (dual port functionality) table 7-8. power consumption ? d3 state (dual port functionality) @1000 mb/s @ 10 gb/s typ icc (ma) typ icc (ma) max icc (ma) 3.3 v dc 21 21 21 1.8 v dc 289 289 289 1.2 v dc 1903 3502 4925 total device power (mw) 2873 4791 6500 note: a. typical conditions: room temperature (ta) = 25 c, nominal voltages and continuous network traffic at link speed. wol enabled @ 1000 mb/s device disabled c typ icc (ma) typ icc (ma) 3.3 v dc 21 21 1.8 v dc 51 51 1.2 v dc 1244 486 total device power (mw) 1654 744 note:
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 535 table 7-9. power consumption ? single port ? d0 ? active link/second port disabled @ 1000 mb/s @ 10 gb/s typ icc (ma) typ icc (ma) max icc (ma) 3.3 v dc 21 21 21 1.8 v dc 289 289 289 1.2 v dc 1484 2378 4016 total device power (mw) 2370 3442 5409 note:
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 536 october 2010 7.5 dc specifications 7.5.1 digital i/o table 7-10. digital i/o dc specification symbol parameter conditions min max units note voh output high voltage ioh = -16ma; vcc3p3 = min 2.4 v dc vol output low voltage iol = 10ma; vcc=min 0.4 v dc volled led output low voltage iol = 12ma; vcc3p3 = min 0.4 v dc vih input high voltage 2.0 vcc3p3 + 0.3 v dc 1 vil input low voltage -0.3 0.8 v dc 1 iil input current vcc3p3 = max; vi =3.6v/gnd 15 a ioff current at iddq mode 50 a3 pu internal pull up 3 8 k ? 2,3,4, 5 ipup internal pull up current 0-0.5*vcc3p3[v] 0.43 1 ma 6, 7 built-in hysteresis 100 400 mv cin pin capacitance not measured, only characterized 3 7 pf cload load capacitance timing characterized with this load 0 16 pf note: 1. the input buffer also has hysteresis > 80 mv. 2. internal pull-up maximum was characterized at slow corner (110 c, vcc3p3=min, process slow) 3. internal pull-up minimum was characterized at fast corner (0 c, vcc3p3=max, process fast). 4. external r pull-down recommended ? 400 ? . 5. external r pull-up recommended ? 3 k ? . 6. external buffer recommended strength ? 2 ma. 7. internal pull-up maximum current consumption was characterized at fast corner (0 c, vcc3p3=max, process fast) internal pull-up minimum current consumption was characterized at slow corner (110 c, vcc3p3=min, process slow). the previous table applies to pe_rst_n, led0[3:0], led1[3:0], por_bypass, internal power on reset, lan_pwr_good, main_pwr_ok, jtck, jtdi, jtdo, jtms, jrst_n, sdp0[3:0], sdp1[3:0], flsh_si, flsh_so, flsh_sck, flsh_ce_n, ee_di, ee_do, ee_sk, ee_cs_n.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 537 7.5.2 open drain i/o table 7-11. open drain dc specification 7.5.3 nc-si i/o table 7-12. nc-si input and output pads dc specification symbol parameter condition min max units note v ih input high voltage 2.1 v dc v il input low voltage 0.8 v dc i leakage output leakage current 0 < vin < vcc3p3 +/-10 a2 v ol output low voltage @ ipullup 0.4 v 5 i pullup current sinking vol=0.4v 4 ma c in input pin capacitance 7 pf 3 c load max load pin capacitance 30 pf 3 i offsmb input leakage current vcc3p3 off or floating +/-10 a2 note: 1. table applies to smbd, smbclk, smbalrt _n, pe_wake_n. 2. device meets this, powered or not. 3. characterized, not tested. 4. cload should be calculated according to the external pull-up resistor and the frequency. 5. od no high output drive. vol max=0.4 v dc at 16 ma, vol max=0.2 v dc at 0.1 ma. 6. symbol parameter conditions min max units voh output high voltage ioh = -4 ma; vcc3p3 = min 2.4 v dc vol output low voltage iol = 4ma; vcc3p3 = min 0.4 v dc vih input high voltage 2.0 v dc vil input low voltage 0.8 v dc vihyst input hysteresis 100 mv iil/iih input current vcc3p3 = max; vin =3.6v/gnd 15 a cin input capacitance 5pf ipup pull-up current vout = 0v (gnd) 0.4 1.3 ma
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 538 october 2010 7.6 digital i/f ac specifications 7.6.1 digital i/o ac specification table 7-13. digital i/o ac specification the input delay test conditions: maximum input level = vin = 2.7v; input rise/fall time (0.2vin to 0.8vin) = 1ns (slew rate ~ 1.5ns). parameters description min max cload note tor output time rise 0.2 ns 1 ns 16 pf tof output time fall 0.2 ns 1 ns todr output delay rise 0.8 ns 3 ns todf output delay fall 0.8 ns 3 ns figure 7-2. digital i/o output timing diagram
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 539 figure 7-3. digital i/o input timing diagram
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 540 october 2010 7.6.2 eeprom ac specifications information in this table is applicable over recommended operating range from ta = 0 c to +85 c, vcc3p3 = 3.3 v dc, cload = 1 ttl gate and 16 pf (unless otherwise noted). table 7-14. eeprom ac timing specifications symbol parameter min typ max units note t sck ee_ck clock frequency 0 2 2.1 mhz 1 t ri ee_do rise time 2.5ns 2 s t fi ee_do fall time 2.5ns 2 s t wh ee_ck high time 200 250 ns 2 t wl ee_ck low time 200 250 ns t cs ee_cs_n high time 250 ns t css ee_cs_n setup time 250 ns t csh ee_cs_n hold time 250 ns t su data-in setup time 50 ns t h data-in hold time 50 ns t v output valid 0 200 ns t ho output hold time 0 ns t dis output disable time 250 ns t wc write cycle time 10 ms note: 1. clock is 2 mhz. 2. 50% duty cycle. figure 7-4. eeprom timing characteristics
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 541 7.6.3 flash ac specification information in this table is applicable over recommended operating range from ta = 0 c to +85 c, vcc3p3 = 3.3 v dc, cload = 1 ttl gate and 16 pf (unless otherwise noted).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 542 october 2010 table 7-15. flash ac timing specification symbol parameter min typ max units note t sck flsh_sck clock frequency 20 mhz 2 t ri flsh_so rise time 2.5 20 ns t fi flsh_so fall time 2.5 20 ns t wh flsh_sck high time 20 ns 1 t wl flsh_sck low time 20 ns 1 t cs flsh_ce_n high time 25 ns t css flsh_ce_n setup time 25 ns t csh flsh_ce_n hold time 25 ns t su data-in setup time 5 ns t h data-in hold time 5 ns t v output valid 20 ns t ho output hold time 0 ns t dis output disable time 100 ns t ec erase cycle time per sector 1.1 s t bpc byte program cycle time 60 100 s note: 1. 50% duty cycle. 2. clock is 39.0625 mhz divided by 2.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 543 figure 7-5. flash interface timing
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 544 october 2010 7.6.4 smbus ac specification the 82598 meets the smbus ac specifications as defined in the smbus specification version 2, section 3.1.1. go to www.smbus.org/specs/ for more details. the 82598 also supports 400 khz smbus (as a slave) and in this case meets the following table. table 7-16. smbus timing parameters (slave mode) symbol parameter min typ max units f smb smbus frequency 10 400 khz t buf time between stop and start 1.44 1 1. the actual minimum requirement has to be less. many of these are below the minimums specified by the smbus specification. s t hd:sta hold time after start condition. after this period, the first clock is generated. 0.48 1 s t su:sta start condition setup time 1.6 1 s t su:sto stop condition setup time 1.76 1 s t hd:dat data hold time 0.32 s t low smbclk low time 0.8 1 s t high smbclk high time 1.44 1 s figure 7-6. smbus timing diagram
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 545 7.6.5 nc-si ac specification table 7-17. nc-si ac specification parameter symbol conditions min. typ. max. units ref_clk frequency 50 50+100 ppm mhz ref_clk duty cycle 35 65 % clock-to-out[1] tco 2.5 9 ns signal rise time tr cload ? 25 pf 1 5 ns cload ? 50 pf 1 7 ns signal fall time tf cload ?? 25 pf 1 5 ns cload ??? 50 pf 1 7 ns clock rise time 1 tckr 1 cload ? 50 pf 0.5 3.5 ns clock rise time 2 tckr 2 0.5 3.5 ns clock fall time 1 tckf 1 0.5 3.5 ns clock fall time 2 tckf 2 0.5 3.5 ns txd[1:0], tx_en, rxd[1:0], crs_dv, rx_er data setup to ref_clk rising edge tsu 4 ns txd[1:0], tx_en, rxd[1:0], crs_dv, rx_er data hold from ref_clk rising edge thold 2 ns interface power-up high impedance interval tpwrz 2 us power up transient interval (recommendation) tpwrt 100 ns power up transient level (recommendation) vpwrt -200 200 mv interface power-up output enable interval tpwre 10 ms ext_clk startup interval tclkstrt 100 ms
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 546 october 2010 figure 7-7. nc-si ac specifications
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 547 7.6.6 reset signals for a power-on indication, the 82598 can either use an internal power on reset indication, which monitors the 1.2 v dc power supply, or an external reset through the lan_pwr_good pad. the por_bypass pad defines the reset source. note: when high, the 82598 uses the lan_pwr_good pad as a power-on indication. when low, the 82598 uses the internal power on reset circuit. the timing between the power-up sequence and the different reset signals when using the internal power on reset indication is described in section 3.2.1 . the por_bypass mode is described in section 7.6.6.1 . the device power on logic is described in figure 7-8 . figure 7-8. device power-on logic
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 548 october 2010 7.6.6.1 por_bypass (external) when asserting the por_bypass pad, the 82598 uses the lan_pwr_good pad as a power-on indication that disables the internal power on detection circuit. table 7-18 lists the timing for the external power on signal. lan_pwr_good and por_byppas are regular digital i/o signals and their characteristics are described in section 7.5.1 . figure 7-9. lan_pwr_good timing 7.6.7 pcie dc/ac specification the transmitter and receiver specifications are available in the pcie card electromechanical specification revision 1.1. 7.6.7.1 pcie specification (receiver and transmitter) refer to the pcie specification. 7.6.7.2 pcie specification (input clock) the input clock for pcie relates to a differential input clock in a frequency of 100 mhz. for more details, refer to the pcie card electromechanical specifications (refclk specifications). 7.6.8 reference clock specification the external clock must be 156.25 mhz +/-0.005% (+/- 50 ppm). refer to table 7-19 . vdd in the table refers to the 1.2 v dc supply. table 7-18. timing for external power on signal symbol title description min max units tlpgw lan_pwr_good minimum width minimum width for lan_pwr_good 10 n/a ? s tlpg lan_pwr_good low hold how long it must be low after voltages are in operating range 40 80 ms +3.3/+1.8/+1.2 v dc lan_pwr_good tlpg pe_rst_n tlpg-per tlpgw
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 549 table 7-19. input reference clock dc specification requirements table 7-20. reference clock ac characteristics parameter minimum typical maximum unit rclkextp/n (differential input voltage) 1000 2000 mv (p-p) rclkextp/n (input common mode voltage range) 0.30 (vdd/2-300 mv) 0.60 (vdd/2) 0.90 (vdd/2+300 mv) v dc rclkextp/n (input bias voltage) 1 1. this is the voltage that both rclkextp and rclkextn are internally biased to. 0.67 (vdd*0.64-100 mv) 0.77 (vdd*0.64) 0.87 (vdd*0.64+100 mv) v dc rclkextp/n (differential input jitter) 2 2. 10 hz to 20 hz. 3 ps/rms rclkextp/n (differential input resistance) 10k ? rclkextp/n (single ended capacitance) 5pf figure 7-10. reference clock ac characteristics symbol value name t1 6.4 ns (typical) input clock frequency t2 45%-55% input duty cycle t3 500 ps-1 ns input rise and fall time t4 3.0 ps, rms (maximum) differential input jitter
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 550 october 2010 note: this page intentionally left blank.this page intentionally left blank.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 551 8 design guidelines this section provides recommendations for selecting components and connecting interfaces, dealing with special pins, and some layout guidance. unused interfaces should be terminated with pull-up or pull-down resistors as indicated in this datasheet or reference schematic. note that some unused interfaces must be left open. do not attach pull-up or pull-down resistors to any balls identified as no connect or reserved no connect . there also are reserved pins, identified by rsvd_1p2 and rsvd_vss that need pull-up or pull-down resistors connected to them. the device can enter special test modes unless these strappings are in place. 8.1 connecting the pcie interface the controller connects to the host system using a pcie interface which can be configured to operate in several link modes. these are detailed in the functional description. a link between the ports of two devices is a collection of lanes. each lane has to be ac-coupled between its corresponding transmitter and receiver; with the ac-coupling capacitor located close to the transmitter side (within 1 inch). each end of the link is terminated on the die into nominal 100 ?? differential dc impedance. board termination is not required ? for information on pcie, refer to the pci express* base specification, revision 2.0 and pci express* card electromechanical specification, revision 2.0. 8.1.1 link width configuration the device supports a maximum link width of x8, x4, x2, or x1 as determined by the eeprom lane_width field in the pcie init configuration. this is loaded into the maximum link width field of the pcie capability register (lcap[11:6]; with the silicon default of a x8 link). during link configuration, the platform and the controller negotiate on a common link width. in order for this to work, the chosen maximum number of pcie lanes have to be connected to the host system. 8.1.2 polarity inversion and lane reversal to ease routing, board designers have flexibility to use the different lane reversal modes supported by the 82598. polarity inversion can also be used since the polarity of each differential pair is detected during the link training sequence. when lane reversal is used, some of the down-shift options are not available. for a detailed description of the available combinations, consult the functional description. 8.1.3 pcie reference clock the device requires a 100 mhz differential reference clock, denoted pe_clk_p and pe_clk_n. this signal is typically generated on the system board and routed to the pcie port. for add-in cards, the clock will be furnished at the pcie connector.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 552 october 2010 the frequency tolerance for the pcie reference clock is +/- 300 ppm. 8.1.4 bias resistor for proper biasing of the pcie analog interface, a 1.40 k ? 1% resistor needs to be connected between the pe_rcomp_p and pe_rcomp_n pins. to avoid noise coupled onto this reference signal, place the bias resistor close to the controller chip and keep traces as short as possible. 8.1.5 miscellaneous pcie signals the ethernet controller signals power management events to the system by pulling low the pe_wake# signal. this signal operates like the familiar pci pme# signal. somewhere in the system, this signal has to be pulled high to the auxiliary 3.3 v dc supply rail. the pe_rst# signal, which serves as the familiar reset function for the controller, needs to be connected to the host system?s corresponding signal. 8.2 connecting the maui interfaces the controller has two high speed network interfaces which can be configured in different 1 and 10 gb/s operation modes: bx, cx4, kx, kx4, xaui. choose the appropriate configuration for your environment. 8.3 maui channels lane connections for bx and kx connections, only the first lane has to be connected (txx_l0_p, txx_l0_n; rxx_l0_p, rxx_l0_n). for the rest of the interfaces, all four differential pairs have to be connected per each direction. these signals are 100 ? terminated differential signals that are ac coupled near the receiver. place the ac coupling caps less than 1 inch away from the receiver. for recommended capacitor values, consult the ieee 802.3 specifications. capacitor size should be small to reduce parasitic inductance. use x5r or x7r, +10% capacitors in a 0402 or 0201 package size. 8.3.1 bias resistor for proper biasing of the maui analog interface a 6.49 k ? 1% resistor needs to be connected between the rbias and ground. to avoid noise coupled onto this reference signal, place the bias resistor close to the controller chip and keep traces as short as possible. 8.3.2 xaui, kx/kx4, cx4 and bx layout recommendations this section provides recommendations for routing high-speed interface. the intent is to route this interface optimally using fr4 technology. intel has tested and characterized these recommendations. 8.3.2.1 board stack up example printed circuit boards for these designs typically have six, eight, or more layers. although, the 82598 does not dictate stackup, the following examples are of typical stackups.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 553 microstrip example: ? layer 1 is a signal layer. ? layer 2 is a ground layer. ? layer 3 is used for power planes. ? layer 4 is a signal layer. (careful routing is necessary to prevent cross talk with layer 5.) ? layer 5 is a signal layer. (careful routing is necessary to prevent cross talk with layer 4.) ? layer 6 is used for power planes. ? layer 7 is a signal ground layer. ? layer 8 is a signal layer. note: layer 4 and 5 should be used mostly for low-speed signals because they are referenced to potentially noisy power planes which might also be slotted. stripline example: ? layer 1 is a signal layer. ? layer 2 is a ground layer. ? layer 3 is a signal layer. ? layer 4 is used for power planes ? layer 5 is used for power planes ? layer 6 is a signal layer. ? layer 7 is a signal ground layer. ? layer 8 is a signal layer. note: to avoid the effect of the potentially noisy power planes on the high-speed signals, use offset stripline topology. the dielectric distance between the power plane and signal layer should be three times the distance between ground and signal layer. this board stack up configuration can be adjusted to conform to your company's design rules. 8.3.2.2 trace geometries two types of traces are included: microstrip or stripline. stripline is the preferred solution. stripline transmission line environments offer advantages that improve performance. microstrip trace geometries can be used successfully, but it is our recommendation that stripline geometries be followed. the following table highlights the height pair-to-pair spacing differences that are recommended between stripline and microstrip geometries.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 554 october 2010 table 8-1. pair-to-pair spacing figure 8-1. differential pair spacing 8.3.2.3 other high-speed signal routing practices these generic layout and routing recommendations are applicable for the maui interfaces for the 82598. in order to keep impedance continuity consistent around via antipad regions, intel recommends adding the antipad diameter requirement of >10 mils clearance to vias to gnd and pwr. this ensures that the impedance variance is minimized. enforce differential symmetry, even for grounds. along with ensuring that the maui interface is routed symmetrically in terms of signal routing and balance, we also recommended that gnd paths are be routed symmetrically. this helps to reduce the imbalance that can occur in the different return current paths. for the signal trace between the via and ac coupling capacitors on the maui interface, there is an intrinsic impedance mismatch because of required capacitors. to minimize the overall effect of having vias and ac coupling capacitors, it is recommended that both the via and capacitor layout pad be placed within 100 mils of each other. it is best to use a 0402 capacitor or smaller for the ac coupling components on the maui interface. the pad geometries for an 0402 or smaller components lend themselves to maintaining a more consistent transmission line environment. use smallest possible vias on board to optimize the impedance for the maui interface. type differential pair skew differential pair-to-pair spacing breakout length (routes signals from under package) lane-to- lane skew xaui (maximum trace length) ? microstrip <5 mils 7 x h ; where h=dielectric height to closest plane <200 mils 100 mils 50 cm stripline <5 mils 6 x h; where h=dielectric height to closest plane <200 mils 100 mils 50 cm ? typical routing requirement over fr4 material. recommend 0402 capacitor package size for ac coupling. all other xaui traces should meet the same spacing requirements as stripline.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 555 8.3.2.4 via usage use vias to optimize signal integrity. figure 8-2 shows correct via usage. figure 8-3 shows the type of topology that should be avoided and can be easily avoided in the board design. figure 8-2. correct via usage figure 8-3. incorrect via usage place ground vias adjacent to signal vias used for the maui interface. do not embed vias between the high-speed signals, but place them adjacent to the signal vias. this helps to create a better gnd path for the return current of the ac signals, which in turn helps address impedance mismatches and emc performance. we recommend that, in the breakout region between the via and the capacitor pad, you target a z0 for the via to capacitor trace equal to 50 ? . this minimizes impedance imbalance. . figure 8-4. no vias between high-speed traces
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 556 october 2010 8.3.2.5 reference planes do not cross plane splits with the maui high-speed differential signals. this causes impedance mismatches and negatively affects the return current paths for the board design and layout. refer to figure 8-5 . traces should not cross power or gnd plane splits if at all possible. traces should stay 6x the dielectric height away from plane splits or voids. if traces must cross splits, capacitive coupling should be added. figure 8-5. do not cross plane splits figure 8-6. traces 6x dielectric splits keep rx and tx separate. this helps to minimize crosstalk effects since the tx and rx signals are not synchronous. this is the more "natural" routing method and will occur without much user interference. it is also recommended that the maui signals stay at least 6x dielectric height away from any power or gnd plane split. this improves impedance balance and return current paths. if a high-speed signal needs to reference a power plane, then ensure that the height of the secondary (power) reference plane is at least 3 x h (height) of the primary (ground) reference plane.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 557 8.3.2.6 dielectric weave compensation intel recommends slight variations for trace routing to cross the fiberglass weave ( or, if traces must be straight for most of their length, rotate the cad artwork by 15 ). 8.3.2.7 impedance discontinuities impedance discontinuities cause unwanted signal reflections. minimize vias (signal through holes) and other transmission line irregularities. a total of six through holes (a combination of vias and connector through holes) between the two chips connected by the maui interface is a reasonable maximum budget per differential trace. unused pads and stub traces should also be avoided. 8.3.2.8 reducing circuit inductance traces should be routed over a continuous reference plane with no interruptions. if there are vacant areas on a reference or power plane, the signal conductors should not cross the vacant area. this causes impedance mismatches and associated radiated noise levels. noisy logic grounds should not be located near or under high-speed signals or near sensitive analog pin regions of the lan silicon. if a noisy ground area must be near these sensitive signals or ic pins, ensure sufficient decoupling and bulk capacitance in these areas. noisy logic and switching power supply grounds can sometimes affect sensitive dc subsystems such as analog to digital conversion, operational amplifiers, etc. all ground vias should be connected to every ground plane; and similarly, every power via, to all power planes at equal potential. this helps reduce circuit inductance. another recommendation is to physically locate grounds to minimize the loop area between a signal path and its return path. rise and fall times should be as slow as possible. because signals with fast rise and fall times contain many high frequency harmonics, which can radiate significantly. the most sensitive signal returns closest to the chassis ground should be connected together. this will result in a smaller loop area and reduce the likelihood of crosstalk. the effect of different configurations on the amount of crosstalk can be studied using electronics modeling software. 8.3.2.9 signal isolation to maintain best signal integrity, keep digital signals far away from the analog traces. a good rule of thumb is no digital signal should be within 7x to 10x dielectric height of the differential pairs. if digital signals on other board layers cannot be separated by a ground plane, they should be routed at a right angle (90 degrees) to the differential pairs. if there is another lan controller on the board, take care to keep the differential pairs from that circuit away. same thing applies to switching regulator traces. some rules to follow for signal isolation: ? separate and group signals by function on separate layers if possible. if possible, maintain a gap of 7x to 10x dielectric height between all differential pairs (ethernet) and other nets, but group associated differential pairs together (example: tx with tx and rx with rx). ? over the length of the trace run, each differential pair should be at least 7x to 10x dielectric height away from any parallel signal traces. ? physically group together all components associated with one clock trace to reduce trace length and radiation. ? isolate other i/o signals from high-speed signals to minimize crosstalk, which can increase emi emission and susceptibility to emi from other signals. ? avoid routing high-speed lan traces near other high-frequency signals associated with a video controller, cache controller, processor, or other similar devices.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 558 october 2010 8.3.2.10 power and ground planes good grounding requires minimizing inductance levels in the interconnections and keeping ground returns short, signal loop areas small, and locating decoupling capacitors at or near power inputs to bypass to the signal return. this will significantly reduce emi radiation. the following guidelines help reduce circuit inductance in both backplanes and motherboards: ? route traces over a continuous plane with no interruptions. do not route over a split power or ground plane. if there are vacant areas on a ground or power plane, avoid routing signals over the vacant area. this will increase inductance and increase emi radiation levels. ? use distance and/or extra decoupling capacitors to separate noisy digital grounds from analog grounds to reduce coupling. noisy digital grounds may affect sensitive dc subsystems. ? all ground vias should be connected to every ground plane; and every power via should be connected to all power planes at equal potential. this helps reduce circuit inductance. ? physically locate grounds between a signal path and its return. this will minimize the loop area. ? avoid fast rise/fall times as much as possible. signals with fast rise and fall times contain many high frequency harmonics, which can radiate emi. ? do not route high-speed signals near switching regulator circuits. 8.4 connecting the serial eeprom the controller uses an serial peripheral interface (spi)* eeprom. several words of the eeprom are accessed automatically by the device after reset to provide pre-boot configuration data before it is accessed by host software. the remainder of the eeprom space is available to software for storing the mac address, serial numbers, and additional information. for a complete description of the content stored in the eeprom please consult the nvm map section of this document. 8.4.1 supported eeprom devices table 8-2 lists the spi eeproms that have been found to work satisfactorily with the 82598 device. the spi eeproms used must be rated for a clock rate of at least 2 mhz. table 8-2. supported spi eeprom devices
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 559 use a 128 kb eeprom for all applications until an appropriate size for each application is determined. recommended manufacturer and part numbers are atmel?s at25128n or microchip?s 25lc128. for more information on how to properly attach the eeprom device to the 82598 controller please follow the example provided in the reference schematic. if no eeprom device is used leave ee_ce_n, ee_sck, ee_si, ee_so unconnected. 8.4.2 eeupdate intel has an ms-dos* software utility called eeupdate, which can be used to program eeprom images in development or production environments. to obtain a copy of this program, contact your intel representative. 8.5 connecting the flash the controller provides support for an spi flash device which will be made accessible to the system through the following options: ? the flash base address register (pcie control register at offset 0x14 or 0x18). ? an address range of the ioaddr register, defined by the io base address register (pcie) control register at offset 0x18 or 0x20). ? the expansion rom base address register (pcie control register at offset 0x30). 8.5.1 supported eeprom devices the controller supports spi flash type. all supported flashes have address size of 24 bits. t table 8-3 lists the specific flash types that are supported. table 8-3. supported flash types for more information on how to properly attach the flash device to the controller, follow the example provided in the reference schematic. if no flash device is used leave flsh_ce_n, flsh_sck, flsh_si, flsh_so unconnected.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 560 october 2010 8.6 connecting the manageability interfaces smbus and nc-si are optional interfaces for pass-through and/or configuration traffic between the bmc and the 82598. note: intel recommends that the smbus be connected to the mch or bmc for the eeprom recovery solution. if the connection is to a bmc, it is able to send the eeprom release command. the 82598 can be connected to an external bmc and can operate in one of two modes: ? smbus mode ? nc-si mode note: clock out (if enabled) is provided in all power states (unless the 82598 is disabled). for more information on system management solutions, refer to section 5. . 8.6.1 connecting the smbus interface to connect the smbus interface to the chipset or the bmc, connect the smbd, smbclk and smbalrt_n signals to the corresponding pins of the chipset/bmc (see figure 8-1 ). note that these pins require pull- up resistors to the 3.3 v dc supply rail. if the smbus interface is not used, the previously mentioned pull-up resistors on the smbd, smbclk and smbalrt_n signals still have to be in place. 8.6.2 connecting the nc-si interface the nc-si interface is a connection to an external bmc. it operates as a single interface with an external bmc, where all traffic between the 82598 and the bmc flows through the interface (see figure 8-1 ).
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 561 8.6.3 nc-si electrical interface requirements this section describes the hardware implementation requirements necessary to meet the nc-si physical layer standard. board-level design requirements are included for connecting the 82598 ethernet solution to an external bmc. the layout and connectivity requirements are addressed in low- level detail. this section, in conjunction with the network controller sideband interface specification version 0.8 nc-si specification , also provides the complete board-level requirements for the nc-si solution. the 82598?s on-board smbus port enables network manageability implementations required for remote control and alerting via the lan. with smbus, management packets can be routed to or from a bmc. enhanced pass-through capabilities also enable system remote control over standardized interfaces. also included is a new manageability interface (nc-si) that supports the dmtf preos sideband protocol. an internal management interface called mdio enables the mac (and software) to monitor and control the phy. 8.6.3.1 external baseboard management controller (bmc) the external bmc is required to meet the latest nc-si specification as it relates to the rmii electrical interface. 8.6.3.2 nc-si reference schematic figure 8-2 shows the recommended pull-up and pull-downs that should be used on the nc-si interface regardless of the application, even when not using the interface. ? ncsi_clk_in: a pull down should always be placed on this input to the 82598. ? ncsi_crs_dv: a pull-down should always be used to ensure the data valid is never indicated during start-up when the signal is not driven. figure 8-1. external bmc connections with nc-si and smbus
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 562 october 2010 ? ncsi_rxd_0/1: pull-up resistors should always be used to ensure that these lines stay at a logic high when nothing is driven, the interface is not used, and for multiple drop configurations. ? ncsi_tx_en: a pull-down should always be used to ensure the tx is never enabled during start- up or when the signal is not driven. ? ncsi_txd_0/1: pull-up resistors should always be used to ensure that these lines stay at a logic high when nothing is driven, the interface is not used, and for multiple drop configurations. figure 8-2. nc-si connection requirement - single drop configuration dmtf compliant bmc device ref_clk crs_dv rxd_0 rxd_1 tx_en txd_0 txd_1 50 mhz reference clock buffer 50 mhz 3.3 v dc 10 k 82598 nc-si interface signals ncsi_clk_in (b5) ncsi_crs_dv (a4) ncsi_rxd_0 (b7) ncsi_rxd_1 (a6) ncsi_tx_en (b6) ncsi_txd_0 (b8) ncsi_txd_1 (a7) 10 k 10 k 10 k 10 k 10 k 10 k
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 563 8.7 resets after power is applied to the 82598 controller, it must be reset. there are two ways to do this: (1) using the internal power on reset circuit and (2) using the external lan_pwr_good signal. by default, internal power on reset will reset the chip. if the design relies on internal power on reset, then the power supply sequencing timing requirement (see section 7.4.2 ) between the 1.8 v dc and 1.2 v dc power rails has to be met. if this requirement is impossible to meet, the alternative is to bypass the internal power on reset circuit by pulling por_bypass high and using an external power monitoring solution to provide a lan_pwr_good signal. for lan_pwr_good timing requirements, see section 7.6.6 . table 8-4. reset context for por_bypass and lan_pwr_good it is important to ensure that resets for the bmc and the 82598 are generated within a specific time interval. the nc-si specification calls out a requirement of link establishment in two seconds of the bmc receiving the power good signal from the platform. to achieve link within the time specified, the 82598 and external bmc need to receive power good signals from the platform within one second of each other. this causes an internal power on reset; the nc-si interface is also reset, ready to link. the bmc should poll this interface and to establish link for two seconds to ensure compliance. 8.8 nc-si layout requirements 8.8.1 board impedance the nc-si manageability interface is a single ended signaling environment and as such we recommend a target board and trace impedance of 50 ? plus 20% and minus 10%. this ensures optimal signal integrity. 8.8.2 trace length restrictions we recommend a trace length maximum value from a board placement and routing topology perspective of eight inches for direct connect applications. this ensures signal integrity and quality is preserved from a design perspective and that compliance is met for nc-si electrical requirements. por_bypass active reset circuit if = 0b lan_pwr_good if = 1b external reset lan_pwr_good if = 0b held in reset if = 1b initialized, ready for normal operation
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 564 october 2010 for multi-drop applications, we have a spacing recommendation of maximum four inches between the two packages connected to the same bmc. this is done to keep the overall length between the bmc and the network controller within specification. figure 8-7. nc-si maximum trace length requirement between the 82598 and external bmc for direct connect applications. figure 8-8. nc-si maximum trace length requirement between the 82598 and external bmc for multi-drop applications
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 565 8.8.3 special delay requirements the 82598 controller violates the dmtf nc-si ac timing specification in terms of the hold (thd) time and minimum clock to output timing (tco min), and needs special attention during the layout design. to ensure the controller will be able to communicate with a specification-compliant bmc the following guidelines must be followed: ? the clock traces from the clock source to the bmc and the one from the source to the 82598 have to be length matched within 5 mils. ? make sure there the total skew between the clocks at the input of the bmc and the 82598 is less than 1 ns. this 1 ns should include the skew introduced by the clock buffer and by the difference of input capacitance of the clock input buffers on the bmc and the 82598 respectively, as well as any skew introduced by clock trace length differences. ? the delay introduced by the transmit and receive data lines should be equal, and not less than 0.3 ns. this translates to roughly two inches assuming 150 ps/inch propagation delay. 8.9 connecting the mdio interfaces the 82598 provides one mdio interface for each lan port to be used as configuration interface for an external phy attached to the controller. connect the mdio and mdc signals to the corresponding pins on the phy chip. please make sure to provide a pull up to 3.3 v dc on the mdio signal. 8.10 connecting the software-definable pins (sdps) the controller has eight software-defined pins (sdp) per port that can be used for miscellaneous hardware or software-controllable purposes. these pins and their function are bound to a specific lan device. these pins can each be individually configured to act as either input or output pins via eeprom. the initial value in case of an output can also be configured in the same way, however the silicon default for any of these pins is to be configured as outputs. to avoid signal contention, all eight pins are set as input pins until after eeprom configuration has been loaded. choose the right software definable pins for your applications keeping in mind that two of the eight pins: sdpx_6 and sdpx_7 are open drain, the rest are tri-state buffers. also take in consideration that four of these pins (sdpx_0 ? sdpx_3) can be used as general purpose interrupt (gpi) inputs. to act as gpi pins, the desired pins must be configured as inputs. a separate gpi interrupt-detection enable is then used to enable rising-edge detection of the input pin (rising-edge detection occurs by comparing values sampled at 62.5 mhz, as opposed to an edge-detection circuit). when detected, a corresponding gpi interrupt is indicated in the interrupt cause register. when connecting the software definable pins to different digital signals please keep in mind that these are 3.3 v signals and use level shifting if necessary. the use, direction, and values of sdps are controlled and accessed using fields in the extended sdp control (esdp) and extended od sdp control (eodsdp).
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 566 october 2010 8.11 connecting the light emitting diodes for designs based on the 82598 controller the 82598 controller provides four programmable high-current push-pull (active high) outputs per port to directly drive leds for link activity and speed indication. each lan device provides an independent set of led outputs; these pins and their function are bound to a specific lan device. each of the four led outputs can be individually configured to select the particular event, state, or activity, which will be indicated on that output. in addition, each led can be individually configured for output polarity, as well as for blinking versus non-blinking (steady-state) indication. the led ports are fully programmable through the eeprom interface, ledctl register. in addition, the hardware-default configuration for all led outputs can be specified via an eeprom field, thus supporting led displays configurable to a particular oem preference. please provide a separate current limiting resistors for each led connected. since the leds are likely to be placed close to the board edge and to external interconnects, take care to route the led traces away from potential sources of emi noise. in some cases, it may be desirable to attach filter capacitors. 8.12 connecting the miscellaneous signals 8.12.1 lan disable the 82598 has two signals that can be used for disabling ethernet functions from system bios. lan0_dis_n and lan1_dis_n are the separated port disable signals. each signal can be driven from a system output port. choose outputs from devices that retain their values during reset. for example, some ich gpio outputs transition high during reset. it is important not to use these signals to drive lan0_dis_n or lan1_dis_n because these inputs are latched upon the rising edge of pe_rst_n or an in-band reset end. each phy may be disabled if its lan function's lan disable input indicates that the relevant function should be disabled. since the phy is shared between the lan function and manageability, it may not be desirable to power down the phy in lan disable. the phy_in_lan_disable eeprom bit determines whether the phy (and mac) are powered down when the lan disable pin is asserted. default is not to power down. a lan port can also be disabled through eeprom settings. if the lan_dis eeprom bit is set, the phy enters power down. note, however, that setting the eeprom lan_pci_dis bit does not bring the phy into power down.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 567 table 8-5. pci/lan function index when both lan ports are disabled following a power on reset / lan_pwr_good/ pe_rst_n/ in-band reset the lanx_dis_n signals should be tied statically to low. at this state the device is disabled, lan ports are powered down, all internal clocks are shut and the pcie connection is powered down (similar to l2 state). pci function # lan function select function 0 function 1 both lan functions are enabled 0 lan 0 lan 1 lan 0 is disabled 0 dummy lan1 lan 1 is disabled 0 lan 0 - lan 0 is disabled 1 lan 1 - both lan functions are enabled 1 lan 1 lan 0 lan 1 is disabled 1 dummy lan 0 both lan functions are disabled don?t care all pci functions are disabled whole device is at deep pd
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 568 october 2010 8.12.2 bios handling of device disable assume that in the following power up sequence the lanx_dis_n signals are driven high (or it is already disabled): 1. pcie link is established following the pe_rst_n. 2. bios recognizes that the device should be disabled. 3. bios drives the lanx_dis_n signals to the low level. 4. bios issues pe_rst_n or an in-band pcie reset. 5. as a result, the device samples the lanx_dis_n signals and enters the desired device-disable mode. 6. re-enable could be done by driving high one of the lanx_dis_n signals and then issuing a pe_rst_n to restart the device. 8.12.3 phy disable and device power down signals the controller has two signals dedicated for powering down a connected external phy device. these signals (phyx_pwrdn_n) can be connected to the power down/disable input of the external phy or can be left unconnected. the controller also provides a dev_pwrdn_n output signal that can be used to control the power delivery circuit for the chip based on its internal power state. for detailed operation of these three signals please consult the functional description chapter. 8.13 oscillator design considerations this section provides information regarding oscillators for use with the 82598 controller. all designs require a 156.25 mhz external clock source. the 82598 uses this 156.25 mhz source to generate clocks with frequency up to 3.125 ghz for the high speed interfaces. the chosen oscillator vendor should be consulted early in the design cycle. oscillator manufacturers familiar with networking equipment clock requirements may provide assistance in selecting an optimum, low-cost solution. 8.13.1 oscillator types 8.13.1.1 fixed crystal oscillator a packaged fixed crystal oscillator comprises an inverter, a quartz crystal, and passive components. the device renders a consistent square wave output. oscillators used with microprocessors are supplied in many configurations and tolerances. crystal oscillators can be used in special situations, such as shared clocking among devices. as clock routing can be difficult to accomplish, it is preferable to provide a separate crystal for each device. for intel controllers, it is acceptable to overdrive the internal inverter by connecting a 156.25 mhz external oscillator to refclkin_p and refclkin_n leads . the oscillator should be specified to drive cmos logic levels, and the clock trace to the device should be as short as possible. the chosen device specifications should call for a 45% (minimum) to 55% (maximum) duty cycle and a 50 ppm frequency tolerance.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 569 8.13.1.2 programmable crystal oscillators a programmable oscillator can be configured to operate at many frequencies. the device contains a crystal frequency reference and a phase lock loop (pll) clock generator. the frequency multipliers and divisors are controlled by programmable fuses. plls are prone to exhibit frequency jitter. the transmitted signal can also have considerable jitter even with the programmable oscillator working within its specified frequency tolerance. plls must be designed carefully to lock onto signals over a reasonable frequency range. if the transmitted signal has high jitter and the receiver?s pll loses its lock, then bit errors or link loss can occur. phy devices are deployed for many different communication applications. some phys contain plls with marginal lock range and cannot tolerate the jitter inherent in data transmission clocked with a programmable oscillator. the american national standards institute (ansi) x3.263-1995 standard test method for transmit jitter is not stringent enough to predict pll-to-pll lock failures. therefore, use of programmable oscillators is generally not recommended. 8.13.2 oscillator solution choose a clock oscillator with lvpecl output. when connecting the output of the oscillator to an 82598 controller, use ac coupling. 100nf is reasonable value to use. to avoid unwanted reflections on the clock signal which can lead to non monotonic clock edges, make sure that the transmission line is correctly terminated. a termination example is shown in figure 8-5 . figure 8-9. reference oscillator circuit note: the input clock jitter from the oscillator can impact the 82598 clock and its performance. if output jitter performance is poor, a lower jitter clock oscillator should be chosen.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 570 october 2010 recommended oscillators are: 8.13.3 oscillator layout recommendations oscillators should not be placed near i/o ports or board edges. noise from these devices may be coupled onto the i/o ports or out of the system chassis. oscillators should also be kept away from xaui differential pairs to prevent interference. the reference clock should be routed differentially; use the shortest, most direct traces possible. keep potentially noisy traces away from the clock trace. it is critical to place the termination resistors and ac coupling capacitors as close to the 82598 as possible (less than 250 mils). 8.13.4 reference clock measurement recommendations a low capacitance, high impedance probe (c < 1 pf, r > 500 k ? ) should be used for testing. probing parameters can affect the measurement of the clock amplitude and cause errors in the adjustment. a test should be done after the probe has been removed to ensure circuit operation. 8.14 power supplies the controller requires three power rails: 3.3 v dc, 1.8 v dc and 1.2 v dc. a central power supply can provide all the required voltage sources; or power can be derived from the 3.3 v dc supply and regulated locally using external regulators. if the lan wake capability is used, voltages must remain present during system power down. local regulation of the lan voltages from system 3.3 vmain and 3.3 vaux voltages is recommended. make sure that all the external voltage regulators generate the proper voltage, meet the output current requirements (with adequate margin), and provide the proper power sequencing. for details, see the electrical specification section of this document. 8.14.1 power supply sequencing due to the current demand, a switching voltage regulator (svr) is highly recommended for the 1.2 v dc power rail. regardless of the type of regulator used, all regulators need to adhere to the sequencing shown in the following figure to avoid latch-up and forward-biased internal diodes (1.8 v dc must not exceed 3.3 v dc; 1.2 v dc must not exceed 3.3 v dc; 1.2 v dc must not exceed 1.8 v dc). the power supplies are all expected to ramp during a short power-up internal (recommended interval 20 ms or quicker). the delay between the 1.8 v dc and 1.2 v dc rail, measured at a level of 400 mv, has to be quicker than 500 ? s. do not leave the device in a prolonged state where some, but not all, voltages are applied. table 8-6. part numbers for recommended oscillators valpey fisher vf266b-156.250mhz pletronics inc. pe7744dv-156.25m pericom semiconductor corporation sel3833b-156.2500t mmd components mi3050lat3-156.250mhz-t
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 571 8.14.1.1 using regulators with enable pins the use of regulators with enable pins is very helpful in controlling sequencing. connecting the enable of the 1.8 v dc regulator to 3.3 v dc will allow the 1.8 v dc to ramp. connecting the enable of the 1.2 v dc regulator to the 1.8 v dc output assures that the 1.2 v dc rail will ramp after the 1.8 v dc rail. this provides a quick solution to power sequencing. make sure to check design parameters for inputs with this configuration. alternatively power monitoring chips can be used to provide the proper sequencing by keeping the voltage regulators with lower output in shutdown until the one immediately above doesn?t reach a certain output voltage level. 8.14.2 power supply filtering these filters provide several high-frequency bypass capacitors for each power rail. select values in the range of 0.001 f to 0.1 f and, if possible, orient the capacitors close to the device and adjacent to power pads. traces between decoupling and i/o filter capacitors should be as short and wide as practical. long and thin traces are more inductive and would reduce the intended effect of decoupling capacitors. also for similar reasons, traces to i/o signals and signal terminations should be as short as possible. vias to the decoupling capacitors should be sufficiently large in diameter to decrease series inductance. table 8-7. minimum number of bypass capacitors per power rail. 8.14.3 support for power management and wake up the designer must connect the main_pwr_ok and the aux_pwr signals on the board. these are digital inputs to the 82598 controller and serve the following purpose: the main_pwr_ok will signal the 82598 controller that the main power from the system is up and stable. for example it could be pulled up to the 3.3 v dc main rail, or connected to a power well signal available in the system. when sampled high aux_pwr will indicate that auxiliary power is available to the controller, and therefore the controller advertises d3cold wake up support. the amount of power required for the function (which includes the entire network interface card) is advertised in the power management data register, which is loaded from the eeprom. if wakeup support is desired, aux_pwr needs to be pulled high and the appropriate wakeup lan address filters must also be set. the initial power management settings are specified by eeprom bits. when a wakeup event occurs the controller asserts the pe_waken signal to wake the system up. pe_waken remains asserted until pme status is cleared in the 82598 power management control/ status register. power rail total bulk capacitance 0.1 f 0.001 f 3.3 v dc 22 ? f5 0 1.8 v dc 66 ? f8 0 1.2 v dc 160 ? f40 6
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 572 october 2010 8.15 connecting the jtag port the 82598 10 gigabit ethernet controller contains a test access port (3.3 v dc only) conforming to the ieee 1149.1a-1994 (jtag) boundary scan specification. to use the test access port, connect these balls to pads accessible by your test equipment. for proper operation a pull-down resistor should be connected to the jtck and jrst_n signals and pull up resistors to the jtms and jtdi signals. a bsdl (boundary scan definition language) file describing the 82598 10 gigabit ethernet controller device is available for use in your test environment. the controller also contains an xor test tree mechanism for simple board tests. details of xor tree operation are available from your intel representative. 8.16 thermal design considerations in a system environment, the temperature of a component is a function of both the system and component thermal characteristics. system-level thermal constraints consist of the local ambient temperature at the component, the airflow over the component and surrounding board, and the physical constraints at, above, and surrounding the component that may limit the size of a thermal enhancement (heat sink). the component's case/die temperature depends on: ? component power dissipation ? size ? packaging materials (effective thermal conductivity) ? type of interconnection to the substrate and motherboard ? presence of a thermal cooling solution ? power density of the substrate, nearby components, and motherboard all of these parameters are pushed by the continued trend of technology to increase performance levels (higher operating speeds, mhz) and power density (more transistors). as operating frequencies increase and packaging size decreases, the power density increases and the thermal cooling solution space and airflow become more constrained. the result is an increased emphasis on system design to ensure that thermal design requirements are met for each component in the system. 8.16.1 importance of thermal management the thermal management objective is to ensure system component temperatures are maintained in functional limits. the functional temperature limit is the range in which electrical circuits meet specified performance requirements. operation outside the functional limit can degrade performance, cause logic errors, or cause system damage. temperatures exceeding the maximum operating limits may result in irreversible changes in the device operating characteristics. note that sustained operation at component maximum temperature limit may affect long-term device reliability. 8.16.2 packaging terminology the following is a list of packaging terminology used in this document.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 573 fcbga flip chip ball grid array : a surface-mount package using a combination of flip chip and bga structure whose pcb-interconnect method consists of pb-free solder ball array on the interconnect side of the package. the die is flipped and connected to an organic build-up substrate with c4 bumps. junction : refers to a p-n junction on the silicon. in this document, it is used as a temperature reference point (for example, ja refers to the junction to ambient thermal resistance). ambient : refers to local ambient temperature of the bulk air approaching the component. it can be measured by placing a thermocouple approximately one inch upstream from the component edge. lands : pads on the pcb to which bga balls are soldered. pcb : printed circuit board. printed circuit assembly (pca) : an assembled pcb. thermal design power (tdp) : estimated maximum possible/expected power generated in a component by a realistic application. lfm: linear feet per minute (airflow). ja (theta ja) : thermal resistance junction-to-ambient, c/w. jt (psi jt) : junction-to-top (of package) thermal characterization parameter, c/w. 8.16.3 thermal specifications to ensure proper operation, the thermal solution must maintain a case temperature at or below the values specified in table 8-8 . system-level or component-level thermal enhancements are required to dissipate the generated heat to ensure the case temperature never exceeds the maximum temperatures. table 8-9 lists the thermal performance parameters for the jedec jesd51-2 standard. analysis indicates that real applications are unlikely to cause the 82598 to be at tcase-max for sustained periods of time. given that tcase should reasonably be expected to be a distribution of temperatures, sustained operation at tcase-max may affect long-term reliability of the system, and sustained performance at tcase-max should be evaluated during the thermal design process and steps taken to reduce the tcase temperature. good system airflow is critical to dissipate the highest possible thermal power. the size and number of fans, etc. and their placement in relation to components and airflow channels within the system determine airflow.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 574 october 2010 table 8-8. package thermal characteristics in standard jedec environment table 8-9. t estimated thermal design power the thermal parameters defined above are based on simulated results of packages assembled on standard multi layer 2s2p 1.0-oz cu layer boards in a natural convection environment. the maximum case temperature is based on the maximum junction temperature and defined by the relationship, maximum tcase = tjmax ? ( jt x power) where jt is the junction-to-top (of package) thermal characterization parameter. if the case temperature exceeds the specified tcase max, thermal enhancements such as heat sinks or forced air will be required. ja is the thermal resistance junction-to- ambient of the package. 8.16.3.1 case temperature the 82598 is designed to operate properly as long as the tcase rating is not exceeded. 8.16.4 thermal attributes 8.16.4.1 typical system definition a system with the following attributes was used to generate thermal characteristics data: ? a heatsink case with the default enhanced thermal solution. ? four-layer, 4.5 x 4 inch pcb. 8.16.4.2 package mechanical attributes the 82598 product line is packaged in a 31 mm x 31 mm fcbga. 8.16.4.3 package thermal characteristics see figure 8-10 and table 8-10 to determine an optimum airflow and heatsink combination. your system design may vary from the system board environment used to generate the values shown. package (c/w) (c/w) 31 mm fcbga 14.6 1 1.6 31 mm fcbga -hs 11.9 2 0.6 1 integrated circuit thermal measurement method-electrical test method eia/jesd51-1, integrated circuits thermal test method environmental conditions ? natural convection (still air), no heat sink attached eiajesd51-2. 2 natural convection (still air), heat sink attached. 82598 estimated tdp 1 6.5 w tcase max-hs 2 106 c 3 1 power values shown are preliminary and reflect pre-silicon simulation estimates; once silicon becomes available, maximum power, also known as thermal design power (tdp), is a system design target associated with the maximum component operating temperature specificat ions. maximum power values are determined based on typical dc electrical specification and maximum ambient temperature for a worst-ca se realistic application running at maximum utilization. 2 tcase max-hs is defined as the maximum case temperature with the default enhanced thermal solution attached. 3 this is a not to exceed maximum allowable case temperature.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 575 contact your intel sales representative for product line thermal models. figure 8-10. 82598 max allowable ambient @ 6.5 w table 8-10. 82598 expected tcase (c) for 8.0 mm heat sink at 6.5 w note: the underlined value(s) indicate airflow/ambient combinations that exceed the allowable case temperature for the the 82598 at 7.2 w.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 576 october 2010 8.16.5 thermal enhancements one method frequently used to improve thermal performance is to increase the device surface area by attaching a metallic heatsink to the component top. increasing the surface area of the heatsink reduces the thermal resistance from the heatsink to the air, increasing heat transfer. 8.16.5.1 clearances to be effective, a heatsink should have a pocket of air around it that is free of obstructions. though each design may have unique mechanical restrictions, the recommended clearances for a heatsink used with are shown in figure 8-11 and figure 8-12 . the 8.0 mm heatsink is the recommended thermal solution for the 82598 for 6.5 w and lower. however, if sufficient airflow is not available in your system, an active heat sink can be used with the recommended clearances. figure 8-11. heatsink keep-out restrictions
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 577 8.16.5.2 default enhanced thermal solution if you have no control over the end-user?s thermal environment, or if you wish to bypass the thermal modeling and evaluation process, use the default enhanced thermal solutions. this solution replicates the performance defined at the thermal design power (tdp). if, after implementing the recommended enhanced thermal solution, the case temperature continues to exceed allowable values, then additional cooling is needed. this additional cooling may be achieved by improving airflow to the component and/or adding additional thermal enhancements. a 40x40x10mm active heat sink is an alternative to the passive heat sink. 8.16.5.3 extruded heatsinks if required, the following extruded heatsinks are the suggested. figure 8-13 shows a passive and an active heatsink drawing. figure 8-12. heatsink keep-out restrictions
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 578 october 2010 8.16.5.3.1 attaching the extruded heatsink the extruded heatsink may be attached using clips with a phase change thermal interface material. 8.16.5.3.1.1 clips a well-designed clip, in conjunction with a thermal interface material (tape, grease, etc.) often offers the best combination of mechanical stability. use of a clip requires significant advance planning as mounting holes are required in the pcb. use non-plated mounting with a grounded annular ring on the solder side of the board surrounding the hole. for a typical low-cost clip, set the annular ring inner diameter to 150 mils and an outer diameter to 300 mils. define the ring to have at least eight ground connections. set the solder mask opening for these holes with a radius of 300 mils. 8.16.5.3.1.2 thermal interface (pcm45 series) the pcm45 series from honeywell* is recommended. these thermal interface pads are phase change materials formulated for use in high performance devices requiring minimum thermal resistance. they consist of an electrically non-conductive, dry film that softens at device operating temperatures resulting in greasy-like performance. each pca, system and heatsink combination varies in attach strength. carefully evaluate the reliability of tape attaches prior to high-volume use . 8.16.5.4 thermal considerations for board design the following pcb design guidelines are recommended to maximize the thermal performance of fcbga packages: ? when connecting ground (thermal) vias to the ground planes, do not use thermal-relief patterns. ? thermal-relief patterns are designed to limit heat transfer between the vias and the copper planes, thus constricting the heat flow path from the component to the ground planes in the pcb. ? as board temperature also has an effect on the thermal performance of the package, avoid placing the 82598 adjacent to high-power dissipation devices. ? if airflow exists, locate the components in the mainstream of the airflow path for maximum thermal performance. extruded aluminum heat sink ecb-00181-01-gp fansink figure 8-13. extruded heatsinks
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 579 ? avoid placing the components downstream, behind larger devices or devices with heat sinks that obstruct the air flow or supply excessively heated air. icepak* and flowtherm* models are available; contact your intel representative for information. 8.16.5.4.1 reliability each pca, system and heatsink combination varies in attach strength and long-term adhesive performance. evaluate the reliability of the completed assembly prior to high-volume use. reliability recommendations are shown in table 8-11 . table 8-11. reliability validation 8.16.5.5 thermal interface management for heat-sink solutions to optimize heatsink design, it is important to understand the interface between the heat spreader and the heatsink base. thermal conductivity effectiveness depends on the following: ? bond line thickness ? interface material area ? interface material thermal conductivity 8.16.5.5.1 bond line management the gap between the heat spreader and the heatsink base impacts heat-sink solution performance. the larger the gap between the two surfaces, the greater the thermal resistance. the thickness of the gap is determined by the flatness of both the heatsink base and the heat spreader, plus the thickness of the thermal interface material (for example, psa, thermal grease, epoxy) used to join the two surfaces. 8.16.5.5.2 interface material performance the following factors impact the performance of the interface material between the heat spreader and the heatsink base: ? thermal resistance of the material ? wetting/filling characteristics of the material test1 requirement pass/fail criteria2 mechanical shock 50g trapezoidal, board level 11 ms, 3 shocks/axis visual and electrical check random vibration 7.3g, board level 45 minutes/axis, 50 to 2000 hz visual and electrical check high-temperature life 85 c 2000 hours total checkpoints occur at 168, 500, 1000, and 2000 hours visual and mechanical check thermal cycling per-target environment (for example: -40 c to +85 c) 500 cycles visual and mechanical check humidity 85% relative humidity 85 c, 1000 hours visual and mechanical check 1 performed the above tests on a sample size of at least 12 assemblies from 3 lots of material (total = 36 assemblies). 2 additional pass/fail criteria can be added at your discretion.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 580 october 2010 8.16.5.5.3 thermal resistance of the material thermal resistance describes the ability of the thermal interface material to transfer heat from one surface to another. the higher the thermal resistance, the less efficient the heat transfer. the thermal resistance of the interface material has a significant impact on the thermal performance of the overall thermal solution. the higher the thermal resistance, the larger the temperature drop required across the interface. 8.16.5.5.4 wetting/filling characteristics of the material the wetting/filling characteristic of the thermal interface material is its ability to fill the gap between the heat spreader top surface and the heatsink. since air is an extremely poor thermal conductor, the more completely the interface material fills the gaps, the lower the temperature-drop across the interface, increasing the efficiency of the thermal solution. 8.16.6 measurements for thermal specifications determining the thermal properties of the system requires careful case temperature measurements. this chapter provides guidelines for doing accurate measurements. 8.16.6.1 case temperature measurements special care is required when measuring the tcase temperature to ensure an accurate temperature measurement. use the following guidelines when making tcase measurements: ? measure the surface temperature of the case in the geometric center of the case top. ? calibrate the thermocouples used to measure tcase before making temperature measurements. ? use 36-gauge (maximum) k-type thermocouples. care must be taken to avoid introducing errors into the measurements when measuring a surface temperature that is a different temperature from the surrounding local ambient air. measurement errors may be due to a poor thermal contact between the thermocouple junction and the surface of the package, heat loss by radiation, convection, conduction through thermocouple leads, and/or contact between the thermocouple cement and the heat-sink base (if used). 8.16.6.2 attaching the thermocouple (no heatsink) the following approach is recommended to minimize measurement errors for attaching the thermocouple with no heatsink: ? use 36-gauge or smaller-diameter k-type thermocouples. ? ensure that the thermocouple has been properly calibrated. ? attach the thermocouple bead or junction to the top surface of the package (case) in the center of the heat spreader using high thermal conductivity cements. it is critical that the entire thermocouple lead be butted tightly to the heat spreader. attach the thermocouple at a 0 angle if there is no interference with the thermocouple attach location or leads ( figure 8-14 ). this method is recommended for use with packages not having a heat sink.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 581 figure 8-14. technique for measuring tcase with 0 angle attachment, no heatsink 8.16.6.3 attaching the thermocouple (heatsink) the following approach is recommended to minimize measurement errors for attaching the thermocouple with heatsink: ? use 36-gauge or smaller diameter k-type thermocouples. ? ensure that the thermocouple is properly calibrated. ? attach the thermocouple bead or junction to the case?s top surface in the geometric center using a high thermal conductivity cement. it is critical that the entire thermocouple lead be butted tightly against the case. ? attach the thermocouple at a 90 angle if there is no interference with the thermocouple attach location or leads. this is the preferred method and is recommended for use with packages with heatsinks. ? for testing purposes, a hole (no larger than 0.150? in diameter) must be drilled vertically through the center of the heatsink to route the thermocouple wires out. ? ensure there is no contact between the thermocouple cement and heatsink base. any contact affects the thermocouple reading. figure 8-15. technique for measuring tcase with 90 angle attachment
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 582 october 2010 8.16.7 heatsink and attach suppliers table 8-12. heatsink and attach suppliers 8.16.8 phy suppliers table 8-13. phy suppliers part part number supplier contact extruded al heat sink + clip + pcm45 (tim) assembly generated specific to customer numbering scheme cooler master wendy lin cooler master usa inc., nj office 603 first ave., unit 2c raritan, nj, 08869, usa tel: 1-908-252-9400 fax: 1-908-252-9299 active fansink + pin + spring + pcm45 (tim) assembly ecb-00181-01-gp cooler master wendy lin cooler master usa inc., nj office 603 first ave., unit 2c raritan, nj, 08869, usa tel: 1-908-252-9400 fax: 1-908-252-9299 pcm45 series pcm45f honeywell north america technical contact: paula knoll 1349 moffett park dr. sunnyvale, ca 94089 business: 858-279-2956 interface part number supplier contact xfp (lr/sr) qt2022 applied micro circuits corporation (amcc) amcc sales corporation - 800-935-amcc (2622) 215 moffett park drive sunnyvale, ca 94089 sfp + ael2005 netlogic 1netlogic microsystems - 650-961-6676 1875 charleston rd. mountain view, ca 94043-1215 rj45 (10base-t) tn1010 teranetics teranetics - 408-653-2200 3965 freedom circle 6th floor santa clara, ca 95054
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 583 9. diagnostic registers 9.1 register summary 9.1.1 ghost ecc register - gheccr (0x110b0, rw) undeclared bits are reserved. category offset abbreviation name rw block (internal use only) link diagnostic 0x110b0 gheccr ghost ecc register rw gio field bit(s) initial value description cdem1ee 21 1 completion descriptor memory lan 1 ecc enable. cdam1ee 18 1 completion data memory lan 1 ecc enable. cdem0ee 9 1 completion descriptor memory lan 0 ecc enable. cdam0ee 6 1 completion data memory lan 0 ecc enable.
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 584 october 2010 note: this page intentionally left blank.
intel ? 82598 10 gbe controller reference number: 319282-007 intel ? 82598 10 gbe controller revision number: 3.2 datasheet october 2010 585 10. models, symbols, testing options, schematics and checklists 10.1 models and symbols ibis, bsdl, and hspice modeling data is available from intel. 10.2 physical layer conformance testing physical layer conformance testing (also known as ieee testing) is a fundamental capability for all companies with ethernet lan products. if your company does not have the resources and equipment to perform these tests, consider contracting the tests to an outside facility. once you integrate an external phy with the 82598, the electrical performance of the solution should be characterized for conformance. 10.3 schematics intel ? 82598 10 gbe controller reference schematics are available on developer. see http:// developer.intel.com/products/ethernet/index.htm?iid=nc+ethernet . 10.4 checklists intel ? 82598 10 gbe controller schematic and layout and placement checklists are available on developer. see http://developer.intel.com/products/ethernet/index.htm?iid=nc+ethernet .
intel ? 82598 10 gbe controller intel ? 82598 10 gbe controller reference number: 319282-007 datasheet revision number: 3.2 586 october 2010 note: this page intentionally left blank.

▲Up To Search▲

Price & Availability of 319282-007

	To Download 319282-007 Datasheet File
If you can't view the Datasheet, Please click here to try to view without PDF Reader .