US6591302B2 - Fast-path apparatus for receiving data corresponding to a TCP connection - Google Patents

Fast-path apparatus for receiving data corresponding to a TCP connection Download PDF

Info

Publication number
US6591302B2
US6591302B2 US10/092,967 US9296702A US6591302B2 US 6591302 B2 US6591302 B2 US 6591302B2 US 9296702 A US9296702 A US 9296702A US 6591302 B2 US6591302 B2 US 6591302B2
Authority
US
United States
Prior art keywords
packet
tcp
data
network
host
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime, expires
Application number
US10/092,967
Other versions
US20020147839A1 (en
Inventor
Laurence B. Boucher
Stephen E. J. Blightman
Peter K. Craft
David A. Higgen
Clive M. Philbrick
Daryl D. Starr
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alacritech Inc
Original Assignee
Alacritech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/067,544 external-priority patent/US6226680B1/en
Priority claimed from US09/141,713 external-priority patent/US6389479B1/en
Priority claimed from US09/384,792 external-priority patent/US6434620B1/en
Priority claimed from US09/416,925 external-priority patent/US6470415B1/en
Priority claimed from US09/464,283 external-priority patent/US6427173B1/en
Priority claimed from US09/514,425 external-priority patent/US6427171B1/en
Priority claimed from US09/675,700 external-priority patent/US8621101B1/en
Priority claimed from US09/675,484 external-priority patent/US6807581B1/en
Priority claimed from US09/789,366 external-priority patent/US6757746B2/en
Priority claimed from US09/801,488 external-priority patent/US6687758B2/en
Priority claimed from US09/802,426 external-priority patent/US7042898B2/en
Priority claimed from US09/802,551 external-priority patent/US7076568B2/en
Priority claimed from US09/802,550 external-priority patent/US6658480B2/en
Priority claimed from US09/855,979 external-priority patent/US7133940B2/en
Priority to US10/092,967 priority Critical patent/US6591302B2/en
Application filed by Alacritech Inc filed Critical Alacritech Inc
Assigned to ALACRITECH, INC. reassignment ALACRITECH, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BLIGHTMAN, STEPHAN E.J., BOUCHER, LAURENCE B., CRAFT, PETER K., PHILBRICK, CLIVE M., STARR, DARYL D., HIGGEN, DAVID A.
Priority to US10/246,820 priority patent/US7284070B2/en
Publication of US20020147839A1 publication Critical patent/US20020147839A1/en
Application granted granted Critical
Publication of US6591302B2 publication Critical patent/US6591302B2/en
Priority to US11/821,820 priority patent/US7673072B2/en
Assigned to A-TECH LLC reassignment A-TECH LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ALACRITECH INC.
Assigned to ALACRITECH, INC. reassignment ALACRITECH, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: A-TECH LLC
Adjusted expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/90Buffering arrangements
    • H04L49/901Buffering arrangements using storage descriptor, e.g. read or write pointers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/24Multipath
    • H04L45/245Link aggregation, e.g. trunking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/90Buffering arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/34Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • H04L67/62Establishing a time schedule for servicing the requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • H04L67/63Routing a service request depending on the request content or context
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/161Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/163In-band adaptation of TCP data exchange; In-band control procedures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/165Combined use of TCP and UDP protocols; selection criteria therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/166IP fragmentation; TCP segmentation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/168Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] specially adapted for link layer protocols, e.g. asynchronous transfer mode [ATM], synchronous optical network [SONET] or point-to-point protocol [PPP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/326Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the transport layer [OSI layer 4]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/09Mapping addresses
    • H04L61/10Mapping addresses of different types
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/08Protocols for interworking; Protocol conversion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/12Protocol engines
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22Parsing or analysis of headers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q2213/00Indexing scheme relating to selecting arrangements in general and for multiplex systems
    • H04Q2213/13093Personal computer, PC
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q2213/00Indexing scheme relating to selecting arrangements in general and for multiplex systems
    • H04Q2213/13103Memory
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q2213/00Indexing scheme relating to selecting arrangements in general and for multiplex systems
    • H04Q2213/13204Protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q2213/00Indexing scheme relating to selecting arrangements in general and for multiplex systems
    • H04Q2213/13299Bus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q2213/00Indexing scheme relating to selecting arrangements in general and for multiplex systems
    • H04Q2213/1332Logic circuits
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q2213/00Indexing scheme relating to selecting arrangements in general and for multiplex systems
    • H04Q2213/13345Intelligent networks, SCP

Definitions

  • CD Appendix which is a part of the present disclosure, includes three folders, designated CD Appendix A, CD Appendix B, and CD Appendix C on the compact disc.
  • CD Appendix A contains a hardware description language (verilog code) description of an embodiment of a receive sequencer.
  • CD Appendix B contains microcode executed by a processor that operates in conjunction with the receive sequencer of CD Appendix A.
  • CD Appendix C contains a device driver executable on the host as well as ATCP code executable on the host.
  • a portion of the disclosure of this patent document contains material (other than any portion of the “free BSD” stack included in CD Appendix C) which is subject to copyright protection. The copyright owner of that material has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights.
  • the present invention relates generally to computer or other networks, and more particularly to processing of information communicated between hosts such as computers connected to a network.
  • OSI Open Systems Interconnection
  • TCP/IP transport control protocol
  • IP internet protocol
  • Networks may include, for instance, a high-speed bus such as an Ethernet connection or an internet connection between disparate local area networks (LANs), each of which includes multiple hosts, or any of a variety of other known means for data transfer between hosts.
  • LANs local area networks
  • physical layers are connected to the network at respective hosts, the physical layers providing transmission and receipt of raw data bits via the network.
  • a data link layer is serviced by the physical layer of each host, the data link layers providing frame division and error correction to the data received from the physical layers, as well as processing acknowledgment frames sent by the receiving host.
  • a network layer of each host is serviced by respective data link layers, the network layers primarily controlling size and coordination of subnets of packets of data.
  • a transport layer is serviced by each network layer and a session layer is serviced by each transport layer within each host.
  • Transport layers accept data from their respective session layers and split the data into smaller units for transmission to the other host's transport layer, which concatenates the data for presentation to respective presentation layers.
  • Session layers allow for enhanced communication control between the hosts.
  • Presentation layers are serviced by their respective session layers, the presentation layers translating between data semantics and syntax which may be peculiar to each host and standardized structures of data representation. Compression and/or encryption of data may also be accomplished at the presentation level.
  • Application layers are serviced by respective presentation layers, the application layers translating between programs particular to individual hosts and standardized programs for presentation to either an application or an end user.
  • the TCP/IP standard includes the lower four layers and application layers, but integrates the functions of session layers and presentation layers into adjacent layers.
  • application, presentation and session layers are defined as upper layers
  • transport, network and data link layers are defined as lower layers.
  • each layer The rules and conventions for each layer are called the protocol of that layer, and since the protocols and general functions of each layer are roughly equivalent in various hosts, it is useful to think of communication occurring directly between identical layers of different hosts, even though these peer layers do not directly communicate without information transferring sequentially through each layer below.
  • Each lower layer performs a service for the layer immediately above it to help with processing the communicated information.
  • Each layer saves the information for processing and service to the next layer. Due to the multiplicity of hardware and software architectures, devices and programs commonly employed, each layer is necessary to insure that the data can make it to the intended destination in the appropriate form, regardless of variations in hardware and software that may intervene.
  • control data is added at each layer of the first host regarding the protocol of that layer, the control data being indistinguishable from the original (payload) data for all lower layers of that host.
  • an application layer attaches an application header to the payload data and sends the combined data to the presentation layer of the sending host, which receives the combined data, operates on it and adds a presentation header to the data, resulting in another combined data packet.
  • the data resulting from combination of payload data, application header and presentation header is then passed to the session layer, which performs required operations including attaching a session header to the data and presenting the resulting combination of data to the transport layer.
  • This process continues as the information moves to lower layers, with a transport header, network header and data link header and trailer attached to the data at each of those layers, with each step typically including data moving and copying, before sending the data as bit packets over the network to the second host.
  • the receiving host generally performs the converse of the above-described process, beginning with receiving the bits from the network, as headers are removed and data processed in order from the lowest (physical) layer to the highest (application) layer before transmission to a destination of the receiving host.
  • Each layer of the receiving host recognizes and manipulates only the headers associated with that layer, since to that layer the higher layer control data is included with and indistinguishable from the payload data.
  • Multiple interrupts, valuable central processing unit (CPU) processing time and repeated data copies may also be necessary for the receiving host to place the data in an appropriate form at its intended destination.
  • a computer network is an interconnected collection of autonomous computers, such as internet and intranet devices, including local area networks (LANs), wide area networks (WANs), asynchronous transfer mode (ATM), ring or token ring, wired, wireless, satellite or other means for providing communication capability between separate processors.
  • LANs local area networks
  • WANs wide area networks
  • ATM asynchronous transfer mode
  • ring or token ring wired, wireless, satellite or other means for providing communication capability between separate processors.
  • a computer is defined herein to include a device having both logic and memory functions for processing data, while computers or hosts connected to a network are said to be heterogeneous if they function according to different operating devices or communicate via different architectures.
  • the current invention provides a device for processing network communication that greatly increases the speed of that processing and the efficiency of transferring data being communicated.
  • the invention has been achieved by questioning the long-standing practice of performing multilayered protocol processing on a general-purpose processor.
  • the protocol processing method and architecture that results effectively collapses the layers of a connection-based, layered architecture such as TCP/IP into a single wider layer which is able to send network data more directly to and from a desired location or buffer on a host.
  • This accelerated processing is provided to a host for both transmitting and receiving data, and so improves performance whether one or both hosts involved in an exchange of information have such a feature.
  • the accelerated processing includes employing representative control instructions for a given message that allow data from the message to be processed via a fast-path which accesses message data directly at its source or delivers it directly to its intended destination.
  • This fast-path bypasses conventional protocol processing of headers that accompany the data.
  • the fast-path employs a specialized microprocessor designed for processing network communication, avoiding the delays and pitfalls of conventional software layer processing, such as repeated copying and interrupts to the CPU.
  • the fast-path replaces the states that are traditionally found in several layers of a conventional network stack with a single state machine encompassing all those layers, in contrast to conventional rules that require rigorous differentiation and separation of protocol layers.
  • the host retains a sequential protocol processing stack which can be employed for setting up a fast-path connection or processing message exceptions.
  • the specialized microprocessor and the host intelligently choose whether a given message or portion of a message is processed by the microprocessor or the host stack.
  • One embodiment is a method of generating a fast-path response to a packet received onto a network interface device where the packet is received over a TCP/IP network connection and where the TCP/IP network connection is identified at least in part by a TCP source port, a TCP destination port, an IP source address, and an IP destination address.
  • the method comprises: 1) Examining the packet and determining from the packet the TCP source port, the TCP destination port, the IP source address, and the IP destination address; 2) Accessing an appropriate template header stored on the network interface device.
  • the template header has TCP fields and IP fields; 3) Employing a finite state machine that implements both TCP protocol processing and IP protocol processing to fill in the TCP fields and IP fields of the template header; and 4) Transmitting the fast-path response from the network interface device.
  • the fast-path response includes the filled in template header and a payload.
  • the finite state machine does not entail a TCP protocol processing layer and a discrete IP protocol processing layer where the TCP and IP layers are executed one after another in sequence. Rather, the finite state machine covers both TCP and IP protocol processing layers.
  • buffer descriptors that point to packets to be transmitted are pushed onto a plurality of transmit queues.
  • a transmit sequencer pops the transmit queues and obtains the buffer descriptors.
  • the buffer descriptors are then used to retrieve the packets from buffers where the packets are stored.
  • the retrieved packets are then transmitted from the network interface device.
  • FIG. 1 is a plan view diagram of a device of the present invention, including a host computer having a communication-processing device for accelerating network communication.
  • FIG. 2 is a diagram of information flow for the host of FIG. 1 in processing network communication, including a fast-path, a slow-path and a transfer of connection context between the fast and slow-paths.
  • FIG. 3 is a flow chart of message receiving according to the present invention.
  • FIG. 4A is a diagram of information flow for the host of FIG. 1 receiving a message packet processed by the slow-path.
  • FIG. 4B is a diagram of information flow for the host of FIG. 1 receiving an initial message packet processed by the fast-path.
  • FIG. 4C is a diagram of information flow for the host of FIG. 4B receiving a subsequent message packet processed by the fast-path.
  • FIG. 4D is a diagram of information flow for the host of FIG. 4C receiving a message packet having an error that causes processing to revert to the slow-path.
  • FIG. 5 is a diagram of information flow for the host of FIG. 1 transmitting a message by either the fast or slow-paths.
  • FIG. 6 is a diagram of information flow for a first embodiment of an intelligent network interface card (INIC) associated with a client having a TCP/IP processing stack.
  • INIC intelligent network interface card
  • FIG. 7 is a diagram of hardware logic for the INIC embodiment shown in FIG. 6, including a packet control sequencer and a fly-by sequencer.
  • FIG. 8 is a diagram of the fly-by sequencer of FIG. 7 for analyzing header bytes as they are received by the INIC.
  • FIG. 9 is a diagram of information flow for a second embodiment of an INIC associated with a server having a TCP/IP processing stack.
  • FIG. 10 is a diagram of a command driver installed in the host of FIG. 9 for creating and controlling a communication control block for the fast-path.
  • FIG. 11 is a diagram of the TCP/IP stack and command driver of FIG. 10 configured for NetBios communications.
  • FIG. 12 is a diagram of a communication exchange between the client of FIG. 6 and the server of FIG. 9 .
  • FIG. 13 is a diagram of hardware functions included in the INIC of FIG. 9 .
  • FIG. 14 is a diagram of a trio of pipelined microprocessors included in the INIC of FIG. 13, including three phases with a processor in each phase.
  • FIG. 15A is a diagram of a first phase of the pipelined microprocessor of FIG. 14 .
  • FIG. 15B is a diagram of a second phase of the pipelined microprocessor of FIG. 14 .
  • FIG. 15C is a diagram of a third phase of the pipelined microprocessor of FIG. 14 .
  • FIG. 16 is a diagram of a plurality of queue storage units that interact with the microprocessor of FIG. 14 and include SRAM and DRAM.
  • FIG. 17 is a diagram of a set of status registers for the queues storage units of FIG. 16 .
  • FIG. 18 is a diagram of a queue manager, which interacts, with the queue storage units and status registers of FIG. 16 and FIG. 17 .
  • FIGS. 19A-D are diagrams of various stages of a least-recently-used register that is employed for allocating cache memory.
  • FIG. 20 is a diagram of the devices used to operate the least-recently-used register of FIGS. 19A-D.
  • FIG. 21 is another diagram of Intelligent Network Interface Card (INIC) 200 of FIG. 13 .
  • INIC Intelligent Network Interface Card
  • FIG. 22 is a diagram of the receive sequencer of FIG. 21 .
  • FIG. 23 is a diagram illustrating a “fast-path” transfer of data of a multi-packet message from INIC 200 to a destination 2311 in host 20 .
  • FIG. 1 shows a host 20 of the present invention connected by a network 25 to a remote host 22 .
  • the increase in processing speed achieved by the present invention can be provided with an intelligent network interface card (INIC) that is easily and affordably added to an existing host, or with a communication processing device (CPD) that is integrated into a host, in either case freeing the host CPU from most protocol processing and allowing improvements in other tasks performed by that CPU.
  • the host 20 in a first embodiment contains a CPU 28 and a CPD 30 connected by a host bus 33 .
  • the CPD 30 includes a microprocessor designed for processing communication data and memory buffers controlled by a direct memory access (DMA) unit.
  • DMA direct memory access
  • Also connected to the host bus 33 is a storage device 35 , such as a semiconductor memory or disk drive, along with any related controls.
  • the host CPU 28 controls a protocol processing stack 44 housed in storage 35 , the stack including a data link layer 36 , network layer 38, transport layer 40 , upper layer 46 and an upper layer interface 42 .
  • the upper layer 46 may represent a session, presentation and/or application layer, depending upon the particular protocol being employed and message communicated.
  • the upper layer interface 42 along with the CPU 28 and any related controls can send or retrieve a file to or from the upper layer 46 or storage 35 , as shown by arrow 48 .
  • a connection context 50 has been created, as will be explained below, the context summarizing various features of the connection, such as protocol type and source and destination addresses for each protocol layer.
  • the context may be passed between an interface for the session layer 42 and the CPD 30 , as shown by arrows 52 and 54 , and stored as a communication control block (CCB) at either CPD 30 or storage 35 .
  • CB communication control block
  • the CPD 30 When the CPD 30 holds a CCB defining a particular connection, data received by the CPD from the network and pertaining to the connection is referenced to that CCB and can then be sent directly to storage 35 according to a fast-path 58 , bypassing sequential protocol processing by the data link 36 , network 38 and transport 40 layers. Transmitting a message, such as sending a file from storage 35 to remote host 22 , can also occur via the fast-path 58 , in which case the context for the file data is added by the CPD 30 referencing a CCB, rather than by sequentially adding headers during processing by the transport 40 , network 38 and data link 36 layers.
  • the DMA controllers of the CPD 30 perform these transfers between CPD and storage 35 .
  • the CPD 30 collapses multiple protocol stacks each having possible separate states into a single state machine for fast-path processing.
  • exception conditions may occur that are not provided for in the single state machine, primarily because such conditions occur infrequently and to deal with them on the CPD would provide little or no performance benefit to the host.
  • Such exceptions can be CPD 30 or CPU 28 initiated.
  • An advantage of the invention includes the manner in which unexpected situations that occur on a fast-path CCB are handled.
  • the CPD 30 deals with these rare situations by passing back or flushing to the host protocol stack 44 the CCB and any associated message frames involved, via a control negotiation.
  • the exception condition is then processed in a conventional manner by the host protocol stack 44 . At some later time, usually directly after the handling of the exception condition has completed and fast-path processing can resume, the host stack 44 hands the CCB back to the CPD.
  • the custom designed network microprocessor can have independent processors for transmitting and receiving network information, and further processors for assisting and queuing.
  • a preferred microprocessor embodiment includes a pipelined trio of receive, transmit and utility processors. DMA controllers are integrated into the implementation and work in close concert with the network microprocessor to quickly move data between buffers adjacent to the controllers and other locations such as long term storage. Providing buffers logically adjacent to the DMA controllers avoids unnecessary loads on the PCI bus.
  • FIG. 3 diagrams the general flow of messages received according to the current invention.
  • a large TCP/IP message such as a file transfer may be received by the host from the network in a number of separate, approximately 64 KB transfers, each of which may be split into many, approximately 1.5 KB frames or packets for transmission over a network.
  • Novell NetWare protocol suites running Sequenced Packet Exchange Protocol (SPX) or NetWare Core Protocol (NCP) over Internetwork Packet Exchange (IPX) work in a similar fashion.
  • SPX Sequenced Packet Exchange Protocol
  • NCP NetWare Core Protocol
  • IPX Internetwork Packet Exchange
  • TCP Transaction TCP
  • TTCP Transaction TCP
  • T/TCP Transaction TCP
  • each packet conventionally includes a portion of the data being transferred, as well as headers for each of the protocol layers and markers for positioning the packet relative to the rest of the packets of this message.
  • a message packet or frame When a message packet or frame is received 47 from a network by the CPD, it is first validated by a hardware assist. This includes determining the protocol types of the various layers, verifying relevant checksums, and summarizing 57 these findings into a status word or words. Included in these words is an indication whether or not the frame is a candidate for fast-path data flow. Selection 59 of fast-path candidates is based on whether the host may benefit from this message connection being handled by the CPD, which includes determining whether the packet has header bytes indicating particular protocols, such as TCP/IP or SPX/IPX for example. The small percent of frames that are not fast-path candidates are sent 61 to the host protocol stacks for slow-path protocol processing.
  • Subsequent network microprocessor work with each fast-path candidate determines whether a fast-path connection such as a TCP or SPX CCB is already extant for that candidate, or whether that candidate may be used to set up a new fast-path connection, such as for a TTCP/IP transaction.
  • the validation provided by the CPD provides acceleration whether a frame is processed by the fast-path or a slow-path, as only error free, validated frames are processed by the host CPU even for the slow-path processing.
  • All received message frames which have been determined by the CPD hardware assist to be fast-path candidates are examined 53 by the network microprocessor or INIC comparator circuits to determine whether they match a CCB held by the CPD.
  • the CPD removes lower layer headers and sends 69 the remaining application data from the frame directly into its final destination in the host using direct memory access (DMA) units of the CPD.
  • DMA direct memory access
  • This operation may occur immediately upon receipt of a message packet, for example when a TCP connection already exists and destination buffers have been negotiated, or it may first be necessary to process an initial header to acquire a new set of final destination addresses for this transfer. In this latter case, the CPD will queue subsequent message packets while waiting for the destination address, and then DMA the queued application data to that destination.
  • a fast-path candidate that does not match a CCB may be used to set up a new fast-path connection, by sending 65 the frame to the host for sequential protocol processing.
  • the host uses this frame to create 51 a CCB, which is then passed to the CPD to control subsequent frames on that connection.
  • the CCB which is cached 67 in the CPD, includes control and state information pertinent to all protocols that would have been processed had conventional software layer processing been employed.
  • the CCB also contains storage space for per-transfer information used to facilitate moving application-level data contained within subsequent related message packets directly to a host application in a form available for immediate usage.
  • the CPD takes command of connection processing upon receiving a CCB for that connection from the host.
  • FIG. 4A when a message packet is received from the remote host 22 via network 25 , the packet enters hardware receive logic 32 of the CPD 30 , which checksums headers and data, and parses the headers, creating a word or words which identify the message packet and status, storing the headers, data and word temporarily in memory 60 . As well as validating the packet, the receive logic 32 indicates with the word whether this packet is a candidate for fast-path processing.
  • FIG. 4A depicts the case in which the packet is not a fast-path candidate, in which case the CPD 30 sends the validated headers and data from memory 60 to data link layer 36 along an internal bus for processing by the host CPU, as shown by arrow 56 .
  • the packet is processed by the host protocol stack 44 of data link 36 , network 38 , transport 40 and session 42 layers, and data (D) 63 from the packet may then be sent to storage 35 , as shown by arrow 65 .
  • FIG. 4B depicts the case in which the receive logic 32 of the CPD determines that a message packet is a candidate for fast-path processing, for example by deriving from the packet's headers that the packet belongs to a TCP/IP, TTCP/IP or SPX/IPX message.
  • a processor 55 in the CPD 30 then checks to see whether the word that summarizes the fast-path candidate matches a CCB held in a cache 62 . Upon finding no match for this packet, the CPD sends the validated packet from memory 60 to the host protocol stack 44 for processing.
  • Host stack 44 may use this packet to create a connection context for the message, including finding and reserving a destination for data from the message associated with the packet, the context taking the form of a CCB.
  • the present embodiment employs a single specialized host stack 44 for processing both fast-path and non-fast-path candidates, while in an embodiment described below fast-path candidates are processed by a different host stack than non-fast-path candidates.
  • Some data (D 1 ) 66 from that initial packet may optionally be sent to the destination in storage 35 , as shown by arrow 68 .
  • the CCB is then sent to the CPD 30 to be saved in cache 62 , as shown by arrow 64 .
  • the initial packet may be part of a connection initialization dialogue that transpires between hosts before the CCB is created and passed to the CPD 30 .
  • the packet headers and data are validated by the receive logic 32 , and the headers are parsed to create a summary of the message packet and a hash for finding a corresponding CCB, the summary and hash contained in a word or words.
  • the word or words are temporarily stored in memory 60 along with the packet.
  • the processor 55 checks for a match between the hash and each CCB that is stored in the cache 62 and, finding a match, sends the data (D 2 ) 70 via a fast-path directly to the destination in storage 35 , as shown by arrow 72 , bypassing the session layer 42 , transport layer 40 , network layer 38 and data link layer 36 .
  • the remaining data packets from the message can also be sent by DMA directly to storage, avoiding the relatively slow protocol layer processing and repeated copying by the CPU stack 44 .
  • FIG. 4D shows the procedure for handling the rare instance when a message for which a fast-path connection has been established, such as shown in FIG. 4C, has a packet that is not easily handled by the CPD.
  • the packet is sent to be processed by the protocol stack 44 , which is handed the CCB for that message from cache 62 via a control dialogue with the CPD, as shown by arrow 76 , signaling to the CPU to take over processing of that message.
  • Slow-path processing by the protocol stack then results in data (D 3 ) 80 from the packet being sent, as shown by arrow 82 , to storage 35 .
  • the CCB can be handed back via a control dialogue to the cache 62 , so that payload data from subsequent packets of that message can again be sent via the fast-path of the CPD 30 .
  • the CPU and CPD together decide whether a given message is to be processed according to fast-path hardware processing or more conventional software processing by the CPU.
  • Transmission of a message from the host 20 to the network 25 for delivery to remote host 22 also can be processed by either sequential protocol software processing via the CPU or accelerated hardware processing via the CPD 30 , as shown in FIG. 5.
  • a message (M) 90 that is selected by CPU 28 from storage 35 can be sent to session layer 42 for processing by stack 44 , as shown by arrows 92 and 96 .
  • data packets can bypass host stack 44 and be sent by DMA directly to memory 60 , with the processor 55 adding to each data packet a single header containing all the appropriate protocol layers, and sending the resulting packets to the network 25 for transmission to remote host 22 .
  • This fast-path transmission can greatly accelerate processing for even a single packet, with the acceleration multiplied for a larger message.
  • a message for which a fast-path connection is not extant thus may benefit from creation of a CCB with appropriate control and state information for guiding fast-path transmission.
  • a traditional connection-based message such as typified by TCP/IP or SPX/IPX
  • the CCB is created during connection initialization dialogue.
  • the CCB can be created with the same transaction that transmits payload data.
  • the transmission of payload data may be a reply to a request that was used to set up the fast-path connection.
  • the CCB provides protocol and status information regarding each of the protocol layers, including which user is involved and storage space for per-transfer information.
  • the CCB is created by protocol stack 44 , which then passes the CCB to the CPD 30 by writing to a command register of the CPD, as shown by arrow 98 .
  • the processor 55 moves network frame-sized portions of the data from the source in host memory 35 into its own memory 60 using DMA, as depicted by arrow 99 .
  • the processor 55 then prepends appropriate headers and checksums to the data portions, and transmits the resulting frames to the network 25 , consistent with the restrictions of the associated protocols.
  • the CPD 30 After the CPD 30 has received an acknowledgement that all the data has reached its destination, the CPD will then notify the host 35 by writing to a response buffer.
  • fast-path transmission of data communications also relieves the host CPU of per-frame processing.
  • an interrupt only occurs (at the most) at the beginning and end of an entire upper-layer message transaction, and there are no interrupts for the sending or receiving of each lower layer portion or packet of that transaction.
  • a simplified intelligent network interface card (INIC) 150 is shown in FIG. 6 to provide a network interface for a host 152 .
  • Hardware logic 171 of the INIC 150 is connected to a network 155 , with a peripheral bus (PCI) 157 connecting the INIC and host.
  • the host 152 in this embodiment has a TCP/IP protocol stack, which provides a slow-path 158 for sequential software processing of message frames received from the network 155 .
  • the host 152 protocol stack includes a data link layer 160 , network layer 162 , a transport layer 164 and an application layer 166 , which provides a source or destination 168 for the communication data in the host 152 .
  • Other layers which are not shown, such as session and presentation layers, may also be included in the host stack 152 , and the source or destination may vary depending upon the nature of the data and may actually be the application layer.
  • the INIC 150 has a network processor 170 which chooses between processing messages along a slow-path 158 that includes the protocol stack of the host, or along a fast-path 159 that bypasses the protocol stack of the host.
  • Each received packet is processed on the fly by hardware logic 171 contained in INIC 150 , so that all of the protocol headers for a packet can be processed without copying, moving or storing the data between protocol layers.
  • the hardware logic 171 processes the headers of a given packet at one time as packet bytes pass through the hardware, by categorizing selected header bytes. Results of processing the selected bytes help to determine which other bytes of the packet are categorized, until a summary of the packet has been created, including checksum validations.
  • the processed headers and data from the received packet are then stored in INIC storage 185 , as well as the word or words summarizing the headers and status of the packet.
  • the INIC 150 may be connected to a peripheral storage device such as a disk drive which has an IDE, SCSI or similar interface, with a file cache for the storage device residing on the memory 185 of the INIC 150 .
  • a peripheral storage device such as a disk drive which has an IDE, SCSI or similar interface
  • file cache for the storage device residing on the memory 185 of the INIC 150 .
  • Several such network interfaces may exist for a host, with each interface having an associated storage device.
  • a received message packet first enters a media access controller 172 , which controls INIC access to the network and receipt of packets and can provide statistical information for network protocol management. From there, data flows one byte at a time into an assembly register 174 , which in this example is 128 bits wide.
  • the data is categorized by a fly-by sequencer 178 , as will be explained in more detail with regard to FIG. 8, which examines the bytes of a packet as they fly by, and generates status from those bytes that will be used to summarize the packet. The status thus created is merged with the data by a multiplexor 180 and the resulting data stored in SRAM 182 .
  • a packet control sequencer 176 oversees the fly-by sequencer 178 , examines information from the media access controller 172 , counts the bytes of data, generates addresses, moves status and manages the movement of data from the assembly register 174 to SRAM 182 and eventually DRAM 188 .
  • the packet control sequencer 176 manages a buffer in SRAM 182 via SRAM controller 183 , and also indicates to a DRAM controller 186 when data needs to be moved from SRAM 182 to a buffer in DRAM 188 .
  • the packet control sequencer 176 will move the status that has been generated in the fly-by sequencer 178 out to the SRAM 182 and to the beginning of the DRAM 188 buffer to be prepended to the packet data.
  • the packet control sequencer 176 requests a queue manager 184 to enter a receive buffer descriptor into a receive queue, which in turn notifies the processor 170 that the packet has been processed by hardware logic 171 and its status summarized.
  • FIG. 8 shows that the fly-by sequencer 178 has several tiers, with each tier generally focusing on a particular portion of the packet header and thus on a particular protocol layer, for generating status pertaining to that layer.
  • the fly-by sequencer 178 in this embodiment includes a media access control sequencer 191 , a network sequencer 192 , a transport sequencer 194 and a session sequencer 195 . Sequencers pertaining to higher protocol layers can additionally be provided.
  • the fly-by sequencer 178 is reset by the packet control sequencer 176 and given pointers by the packet control sequencer that tell the fly-by sequencer whether a given byte is available from the assembly register 174 .
  • the media access control sequencer 191 determines, by looking at bytes 0 - 5 , that a packet is addressed to host 152 rather than or in addition to another host. Offsets 12 and 13 of the packet are also processed by the media access control sequencer 191 to determine the type field, for example whether the packet is Ethernet or 802.3. If the type field is Ethernet those bytes also tell the media access control sequencer 191 the packet's network protocol type. For the 802.3 case, those bytes instead indicate the length of the entire frame, and the media access control sequencer 191 will check eight bytes further into the packet to determine the network layer type.
  • the network sequencer 192 validates that the header length received has the correct length, and checksums the network layer header.
  • the network layer header is known to be IP or IPX from analysis done by the media access control sequencer 191 . Assuming for example that the type field is 802.3 and the network protocol is IP, the network sequencer 192 analyzes the first bytes of the network layer header, which will begin at byte 22 , in order to determine IP type. The first bytes of the IP header will be processed by the network sequencer 192 to determine what IP type the packet involves.
  • Determining that the packet involves, for example, IP version 4, directs further processing by the network sequencer 192 , which also looks at the protocol type located ten bytes into the IP header for an indication of the transport header protocol of the packet. For example, for IP over Ethernet, the IP header begins at offset 14 , and the protocol type byte is offset 23 , which will be processed by network logic to determine whether the transport layer protocol is TCP, for example. From the length of the network layer header, which is typically 20-40 bytes, network sequencer 192 determines the beginning of the packet's transport layer header for validating the transport layer header. Transport sequencer 194 may generate checksums for the transport layer header and data, which may include information from the IP header in the case of TCP at least.
  • transport sequencer 194 also analyzes the first few bytes in the transport layer portion of the header to determine, in part, the TCP source and destination ports for the message, such as whether the packet is NetBios or other protocols.
  • Byte 12 of the TCP header is processed by the transport sequencer 194 to determine and validate the TCP header length.
  • Byte 13 of the TCP header contains flags that may, aside from ack flags and push flags, indicate unexpected options, such as reset and fin, that may cause the processor to categorize this packet as an exception.
  • TCP offset bytes 16 and 17 are the checksum, which is pulled out and stored by the hardware logic 171 while the rest of the frame is validated against the checksum.
  • Session sequencer 195 determines the length of the session layer header, which in the case of NetBios is only four bytes, two of which tell the length of the NetBios payload data, but which can be much larger for other protocols.
  • the session sequencer 195 can also be used to categorize the type of message as read or write, for example, for which the fast-path may be particularly beneficial.
  • Further upper layer logic processing, depending upon the message type, can be performed by the hardware logic 171 of packet control sequencer 176 and fly-by sequencer 178 .
  • hardware logic 171 intelligently directs hardware processing of the headers by categorization of selected bytes from a single stream of bytes, with the status of the packet being built from classifications determined on the fly.
  • the packet control sequencer 176 adds the status information generated by the fly-by sequencer 178 and any status information generated by the packet control sequencer 176 , and prepends (adds to the front) that status information to the packet, for convenience in handling the packet by the processor 170 .
  • the additional status information generated by the packet control sequencer 176 includes media access controller 172 status information and any errors discovered, or data overflow in either the assembly register or DRAM buffer, or other miscellaneous information regarding the packet.
  • the packet control sequencer 176 also stores entries into a receive buffer queue and a receive statistics queue via the queue manager 184 .
  • An advantage of processing a packet by hardware logic 171 is that the packet does not, in contrast with conventional sequential software protocol processing, have to be stored, moved, copied or pulled from storage for processing each protocol layer header, offering dramatic increases in processing efficiency and savings in processing time for each packet.
  • the packets can be processed at the rate bits are received from the network, for example 100 megabits/second for a 100 baseT connection. The time for categorizing a packet received at this rate and having a length of sixty bytes is thus about 5 microseconds.
  • the total time for processing this packet with the hardware logic 171 and sending packet data to its host destination via the fast-path may be about 16 microseconds or less, assuming a 66 MHz PCI bus, whereas conventional software protocol processing by a 300 MHz Pentium II® processor may take as much as 200 microseconds in a busy device. More than an order of magnitude decrease in processing time can thus be achieved with fast-path 159 in comparison with a high-speed CPU employing conventional sequential software protocol processing, demonstrating the dramatic acceleration provided by processing the protocol headers by the hardware logic 171 and processor 170 , without even considering the additional time savings afforded by the reduction in CPU interrupts and host bus bandwidth savings.
  • the processor 170 chooses, for each received message packet held in storage 185 , whether that packet is a candidate for the fast-path 159 and, if so, checks to see whether a fast-path has already been set up for the connection that the packet belongs to. To do this, the processor 170 first checks the header status summary to determine whether the packet headers are of a protocol defined for fast-path candidates. If not, the processor 170 commands DMA controllers in the INIC 150 to send the packet to the host for slow-path 158 processing. Even for a slow-path 158 processing of a message, the INIC 150 thus performs initial procedures such as validation and determination of message type, and passes the validated message at least to the data link layer 160 of the host.
  • the processor 170 checks to see whether the header status summary matches a CCB held by the INIC. If so, the data from the packet is sent along fast-path 159 to the destination 168 in the host. If the fast-path 159 candidate's packet summary does not match a CCB held by the INIC, the packet may be sent to the host 152 for slow-path processing to create a CCB for the message. Employment of the fast-path 159 may also not be needed or desirable for the case of fragmented messages or other complexities. For the vast majority of messages, however, the INIC fast-path 159 can greatly accelerate message processing.
  • the INIC 150 thus provides a single state machine processor 170 that decides whether to send data directly to its destination, based upon information gleaned on the fly, as opposed to the conventional employment of a state machine in each of several protocol layers for determining the destiny of a given packet.
  • a protocol driver of the host selects the processing route based upon whether the indication is fast-path or slow-path.
  • a TCP/IP or SPX/IPX message has a connection that is set up from which a CCB is formed by the driver and passed to the INIC for matching with and guiding the fast-path packet to the connection destination 168 .
  • the driver can create a connection context for the transaction from processing an initial request packet, including locating the message destination 168 , and then passing that context to the INIC in the form of a CCB for providing a fast-path for a reply from that destination.
  • a CCB includes connection and state information regarding the protocol layers and packets of the message.
  • a CCB can include source and destination media access control (MAC) addresses, source and destination IP or IPX addresses, source and destination TCP or SPX ports, TCP variables such as timers, receive and transmit windows for sliding window protocols, and information indicating the session layer protocol.
  • MAC media access control
  • Caching the CCBs in a hash table in the INIC provides quick comparisons with words summarizing incoming packets to determine whether the packets can be processed via the fast-path 159 , while the full CCBs are also held in the INIC for processing.
  • Other ways to accelerate this comparison include software processes such as a B-tree or hardware assists such as a content addressable memory (CAM).
  • CAM content addressable memory
  • INIC microcode or comparator circuits detect a match with the CCB, a DMA controller places the data from the packet in the destination 168 , without any interrupt by the CPU, protocol processing or copying.
  • the destination of the data may be the session, presentation or application layers, or a file buffer cache in the host 152 .
  • FIG. 9 shows an INIC 200 connected to a host 202 that is employed as a file server.
  • This INIC provides a network interface for several network connections employing the 802.3 u standard, commonly known as Fast Ethernet.
  • the INIC 200 is connected by a PCI bus 205 to the server 202 , which maintains a TCP/IP or SPX/IPX protocol stack including MAC layer 212 , network layer 215 , transport layer 217 and application layer 220 , with a source/destination 222 shown above the application layer, although as mentioned earlier the application layer can be the source or destination.
  • the INIC is also connected to network lines 210 , 240 , 242 and 244 , which are preferably Fast Ethernet, twisted pair, fiber optic, coaxial cable or other lines each allowing data transmission of 100 Mb/s, while faster and slower data rates are also possible.
  • Network lines 210 , 240 , 242 and 244 are each connected to a dedicated row of hardware circuits which can each validate and summarize message packets received from their respective network line.
  • line 210 is connected with a first horizontal row of sequencers 250
  • line 240 is connected with a second horizontal row of sequencers 260
  • line 242 is connected with a third horizontal row of sequencers 262
  • line 244 is connected with a fourth horizontal row of sequencers 264 .
  • a network processor 230 determines, based on that summary and a comparison with any CCBs stored in the INIC 200 , whether to send a packet along a slow-path 231 for processing by the host.
  • a large majority of packets can avoid such sequential processing and have their data portions sent by DMA along a fast-path 237 directly to the data destination 222 in the server according to a matching CCB.
  • the fast-path 237 provides an avenue to send data directly from the source 222 to any of the network lines by processor 230 division of the data into packets and addition of full headers for network transmission, again minimizing CPU processing and interrupts.
  • sequencer 250 For clarity only horizontal sequencer 250 is shown active; in actuality each of the sequencer rows 250 , 260 , 262 and 264 offers full duplex communication, concurrently with all other sequencer rows.
  • the specialized INIC 200 is much faster at working with message packets than even advanced general-purpose host CPUs that processes those headers sequentially according to the software protocol stack.
  • SMB server message block
  • TCP/IP Transmission Control Protocol/IP
  • SMB can operate in conjunction with redirector software that determines whether a required resource for a particular operation, such as a printer or a disk upon which a file is to be written, resides in or is associated with the host from which the operation was generated or is located at another host connected to the network, such as a file server.
  • SMB and server/redirector are conventionally serviced by the transport layer; in the present invention SMB and redirector can instead be serviced by the INIC. In this case, sending data by the DMA controllers from the INIC buffers when receiving a large SMB transaction may greatly reduce interrupts that the host must handle.
  • An SMB transmission of the present invention follows essentially the reverse of the above described SMB receive, with data transferred from the host to the INIC and stored in buffers, while the associated protocol headers are prepended to the data in the INIC, for transmission via a network line to a remote host.
  • Processing by the INIC of the multiple packets and multiple TCP, IP, NetBios and SMB protocol layers via custom hardware and without repeated interrupts of the host can greatly increase the speed of transmitting an SMB message to a network line.
  • a message command driver 300 may be installed in host 202 to work in concert with a host protocol stack 310 .
  • the command driver 300 can intervene in message reception or transmittal, create CCBs and send or receive CCBs from the INIC 200 , so that functioning of the INIC, aside from improved performance, is transparent to a user.
  • an INIC memory 304 and an INIC miniport driver 306 which can direct message packets received from network 210 to either the conventional protocol stack 310 or the command protocol stack 300 , depending upon whether a packet has been labeled as a fast-path candidate.
  • the conventional protocol stack 310 has a data link layer 312 , a network layer 314 and a transport layer 316 for conventional, lower layer processing of messages that are not labeled as fast-path candidates and therefore not processed by the command stack 300 . Residing above the lower layer stack 310 is an upper layer 318 , which represents a session, presentation and/or application layer, depending upon the message communicated.
  • the command driver 300 similarly has a data link layer 320 , a network layer 322 and a transport layer 325 .
  • the driver 300 includes an upper layer interface 330 that determines, for transmission of messages to the network 210 , whether a message transmitted from the upper layer 318 is to be processed by the command stack 300 and subsequently the INIC fast-path, or by the conventional stack 310 .
  • the upper layer interface 330 receives an appropriate message from the upper layer 318 that would conventionally be intended for transmission to the network after protocol processing by the protocol stack of the host, the message is passed to driver 300 .
  • the INIC acquires network-sized portions of the message data for that transmission via INIC DMA units, prepends headers to the data portions and sends the resulting message packets down the wire.
  • miniport driver 306 diverts that message packet to command driver 300 for processing.
  • the driver 300 processes the message packet to create a context for that message, with the driver 302 passing the context and command instructions back to the INIC 200 as a CCB for sending data of subsequent messages for the same connection along a fast-path.
  • a least recently used (LRU) algorithm is employed for the case when the INIC cache is full.
  • the driver 300 can also create a connection context for a TTCP request which is passed to the INIC 200 as a CCB, allowing fast-path transmission of a TTCP reply to the request.
  • a message having a protocol that is not accelerated can be processed conventionally by protocol stack 310 .
  • FIG. 11 shows a TCP/IP implementation of command driver software for Microsoft® protocol messages.
  • a conventional host protocol stack 350 includes MAC layer 353 , IP layer 355 and TCP layer 358 .
  • a command driver 360 works in concert with the host stack 350 to process network messages.
  • the command driver 360 includes a MAC layer 363 , an IP layer 366 and an Alacritech TCP (ATCP) layer 373 .
  • the conventional stack 350 and command driver 360 share a network driver interface specification (NDIS) layer 375 , which interacts with the INIC miniport driver 306 .
  • the INIC miniport driver 306 sorts receive indications for processing by either the conventional host stack 350 or the ATCP driver 360 .
  • a TDI filter driver and upper layer interface 380 similarly determines whether messages sent from a TDI user 382 to the network are diverted to the command driver and perhaps to the fast-path of the INIC, or processed by the host stack.
  • FIG. 12 depicts a typical SMB exchange between a client 190 and server 290 , both of which have communication devices of the present invention, the communication devices each holding a CCB defining their connection for fast-path movement of data.
  • the client 190 includes INIC 150 , 802.3 compliant data link layer 160 , IP layer 162 , TCP layer 164 , NetBios layer 166 , and SMB layer 168 .
  • the client has a slow-path 157 and fast-path 159 for communication processing.
  • the server 290 includes INIC 200 , 802.3 compliant data link layer 212 , IP layer 215 , TCP layer 217 , NetBios layer 220 , and SMB 222 .
  • the server is connected to network lines 240 , 242 and 244 , as well as line 210 which is connected to client 190 .
  • the server also has a slow-path 231 and fast-path 237 for communication processing.
  • the client may begin by sending a Read Block Raw (RBR) SMB command across network 210 requesting the first 64 KB of that file on the server 290 .
  • RBR Read Block Raw
  • the RBR command may be only 76 bytes, for example, so the INIC 200 on the server will recognize the message type (SMB) and relatively small message size, and send the 76 bytes directly via the fast-path to NetBios of the server.
  • NetBios will give the data to SMB, which processes the Read request and fetches the 64 KB of data into server data buffers. SMB then calls NetBios to send the data, and NetBios outputs the data for the client.
  • NetBios would call TCP output and pass 64 KB to TCP, which would divide the data into 1460 byte segments and output each segment via IP and eventually MAC (slow-path 231 ).
  • the 64 KB data goes to the ATCP driver along with an indication regarding the client-server SMB connection, which indicates a CCB held by the INIC.
  • the INIC 200 then proceeds to DMA 1460 byte segments from the host buffers, add the appropriate headers for TCP, IP and MAC at one time, and send the completed packets on the network 210 (fast-path 237 ).
  • the INIC 200 will repeat this until the whole 64 KB transfer has been sent. Usually after receiving acknowledgement from the client that the 64 KB has been received, the INIC will then send the remaining 36 KB also by the fast-path 237 .
  • the INIC 150 With INIC 150 operating on the client 190 when this reply arrives, the INIC 150 recognizes from the first frame received that this connection is receiving fast-path 159 processing (TCP/IP, NetBios, matching a CCB), and the ATCP may use this first frame to acquire buffer space for the message. This latter case is done by passing the first 128 bytes of the NetBios portion of the frame via the ATCP fast-path directly to the host NetBios; that will give NetBios/SMB all of the frame's headers. NetBios/SMB will analyze these headers, realize by matching with a request ID that this is a reply to the original RawRead connection, and give the ATCP a 64 K list of buffers into which to place the data.
  • TCP/IP fast-path 159 processing
  • NetBios NetBios, matching a CCB
  • the client buffer list is given to the ATCP, it passes that transfer information to the INIC 150 , and the INIC 150 starts DMAing any frame data that has accumulated into those buffers.
  • FIG. 13 provides a simplified diagram of the INIC 200 , which combines the functions of a network interface controller and a protocol processor in a single ASIC chip 400 .
  • the INIC 200 in this embodiment offers a full-duplex, four channel, 10/100-Megabit per second (Mbps) intelligent network interface controller that is designed for high speed protocol processing for server applications.
  • Mbps 10/100-Megabit per second
  • the INIC 200 can be connected to personal computers, workstations, routers or other hosts anywhere that TCP/IP, TTCP/IP or SPX/IPX protocols are being utilized.
  • the INIC 200 is connected with four network lines 210 , 240 , 242 and 244 , which may transport data along a number of different conduits, such as twisted pair, coaxial cable or optical fiber, each of the connections providing a media independent interface (MII) via commercially available physical layer chips, such as model 80220/80221 Ethernet Media Interface Adapter from SEEQ Technology Incorporated, 47200 Bayside Parkway, Fremont, Calif. 94538.
  • the lines preferably are 802.3 compliant and in connection with the INIC constitute four complete Ethernet nodes, the INIC supporting 10Base-T, 10Base-T2, 100Base-TX, 100Base-FX and 100Base-T4 as well as future interface standards.
  • Physical layer identification and initialization is accomplished through host driver initialization routines.
  • the connection between the network lines 210 , 240 , 242 and 244 and the INIC 200 is controlled by MAC units MAC-A 402 , MAC-B 404 , MAC-C 406 and MAC-D 408 which contain logic circuits for performing the basic functions of the MAC sublayer, essentially controlling when the INIC accesses the network lines 210 , 240 , 242 and 244 .
  • the MAC units 402 - 408 may act in promiscuous, multicast or unicast modes, allowing the INIC to function as a network monitor, receive broadcast and multicast packets and implement multiple MAC addresses for each node.
  • the MAC units 402 - 408 also provide statistical information that can be used for simple network management protocol (SNMP).
  • SNMP simple network management protocol
  • the MAC units 402 , 404 , 406 and 408 are each connected to a transmit and receive sequencer, XMT & RCV-A 418 , XMT & RCV-B 420 , XMT & RCV-C 422 and XMT & RCV-D 424 , by wires 410 , 412 , 414 and 416 , respectively.
  • Each of the transmit and receive sequencers can perform several protocol processing steps on the fly as message frames pass through that sequencer.
  • the transmit and receive sequencers 418 - 422 can compile the packet status for the data link, network, transport, session and, if appropriate, presentation and application layer protocols in hardware, greatly reducing the time for such protocol processing compared to conventional sequential software engines.
  • the transmit and receive sequencers 410 - 414 are connected, by lines 426 , 428 , 430 and 432 to an SRAM and DMA controller 444 , which includes DMA controllers 438 and SRAM controller 442 .
  • Static random access memory (SRAM) buffers 440 are coupled with SRAM controller 442 by line 441 .
  • the SRAM and DMA controllers 444 interact across line 446 with external memory control 450 to send and receive frames via external memory bus 455 to and from dynamic random access memory (DRAM) buffers 460 , which is located adjacent to the IC chip 400 .
  • the DRAM buffers 460 may be configured as 4 MB, 8 MB, 16 MB or 32 MB, and may optionally be disposed on the chip.
  • the SRAM and DMA controllers 444 are connected via line 464 to a PCI Bus Interface Unit (BIU) 468 , which manages the interface between the INIC 200 and the PCI interface bus 257 .
  • the 64-bit, multiplexed BIU 468 provides a direct interface to the PCI bus 257 for both slave and master functions.
  • the INIC 200 is capable of operating in either a 64-bit or 32-bit PCI environment, while supporting 64-bit addressing in either configuration.
  • a microprocessor 470 is connected by line 472 to the SRAM and DMA controllers 444 , and connected via line 475 to the PCI BIU 468 .
  • Microprocessor 470 instructions and register files reside in an on chip control store 480 , which includes a writable on-chip control store (WCS) of SRAM and a read only memory (ROM), and is connected to the microprocessor by line 477 .
  • the microprocessor 470 offers a programmable state machine which is capable of processing incoming frames, processing host commands, directing network traffic and directing PCI bus traffic.
  • Three processors are implemented using shared hardware in a three level pipelined architecture that launches and completes a single instruction for every clock cycle.
  • a receive processor 482 is primarily used for receiving communications while a transmit processor 484 is primarily used for transmitting communications in order to facilitate full duplex communication, while a utility processor 486 offers various functions including overseeing and controlling PCI register access.
  • the instructions for the three processors 482 , 484 and 486 reside in the on-chip control-store 480 .
  • the functions of the three processors can be easily redefined, so that the microprocessor 470 can adapted for a given environment. For instance, the amount of processing required for receive functions may outweigh that required for either transmit or utility functions. In this situation, some receive functions may be performed by the transmit processor 484 and/or the utility processor 486 .
  • an additional level of pipelining can be created to yield four or more virtual processors instead of three, with the additional level devoted to receive functions.
  • the INIC 200 in this embodiment can support up to 256 CCBs which are maintained in a table in the DRAM 460 . There is also, however, a CCB index in hash order in the SRAM 440 to save sequential searching.
  • the CCB is cached in SRAM, with up to sixteen cached CCBs in SRAM in this example. Allocation of the sixteen CCBs cached in SRAM is handled by a least recently used register, described below. These cache locations are shared between the transmit 484 and receive 486 processors so that the processor with the heavier load is able to use more cache buffers.
  • FIG. 14 shows an overview of the pipelined microprocessor 470 , in which instructions for the receive, transmit and utility processors are executed in three alternating phases according to Clock increments I, II and III, the phases corresponding to each of the pipeline stages. Each phase is responsible for different functions, and each of the three processors occupies a different phase during each Clock increment. Each processor usually operates upon a different instruction stream from the control store 480 , and each carries its own program counter and status through each of the phases.
  • a first instruction phase 500 of the pipelined microprocessors completes an instruction and stores the result in a destination operand, fetches the next instruction, and stores that next instruction in an instruction register.
  • a first register set 490 provides a number of registers including the instruction register, and a set of controls 492 for first register set provides the controls for storage to the first register set 490 . Some items pass through the first phase without modification by the controls 492 , and instead are simply copied into the first register set 490 or a RAM file register 533 .
  • a second instruction phase 560 has an instruction decoder and operand multiplexer 498 that generally decodes the instruction that was stored in the instruction register of the first register set 490 and gathers any operands which have been generated, which are then stored in a decode register of a second register set 496 .
  • the first register set 490 , second register set 496 and a third register set 501 which is employed in a third instruction phase 600 , include many of the same registers, as will be seen in the more detailed views of FIGS. 15A-C.
  • the instruction decoder and operand multiplexer 498 can read from two address and data ports of the RAM file register 533 , which operates in both the first phase 500 and second phase 560 .
  • a third phase 600 of the processor 470 has an arithmetic logic unit (ALU) 602 which generally performs any ALU operations on the operands from the second register set, storing the results in a results register included in the third register set 501 .
  • a stack exchange 608 can reorder register stacks, and a queue manager 503 can arrange queues for the processor 470 , the results of which are stored in the third register set.
  • the instructions continue with the first phase then following the third phase, as depicted by a circular pipeline 505 . Note that various functions have been distributed across the three phases of the instruction execution in order to minimize the combinatorial delays within any given phase.
  • each Clock increment takes 15 nanoseconds to complete, for a total of 45 nanoseconds to complete one instruction for each of the three processors.
  • the rotating instruction phases are depicted in more detail in FIGS. 15A-C, in which each phase is shown in a different figure.
  • FIG. 15A shows some specific hardware functions of the first phase 500 , which generally includes the first register set 490 and related controls 492 .
  • the controls for the first register set 492 includes an SRAM control 502 , which is a logical control for loading address and write data into SRAM address and data registers 520 .
  • SRAM control 502 is a logical control for loading address and write data into SRAM address and data registers 520 .
  • the output of the ALU 602 from the third phase 600 may be placed by SRAM control 502 into an address register or data register of SRAM address and data registers 520 .
  • a load control 504 similarly provides controls for writing a context for a file to file context register 522
  • another load control 506 provides controls for storing a variety of miscellaneous data to flip-flop registers 525 .
  • ALU condition codes such as whether a carried bit is set, get clocked into ALU condition codes register 528 without an operation performed in the first phase 500 .
  • Flag decodes 508 can perform various functions, such as setting locks, that get stored in flag registers 530 .
  • the RAM file register 533 has a single write port for addresses and data and two read ports for addresses and data, so that more than one register can be read from at one time. As noted above, the RAM file register 533 essentially straddles the first and second phases, as it is written in the first phase 500 and read from in the second phase 560 .
  • a control store instruction 510 allows the reprogramming of the processors due to new data in from the control store 480 , not shown in this figure, the instructions stored in an instruction register 535 . The address for this is generated in a fetch control register 511 , which determines which address to fetch, the address stored in fetch address register 538 .
  • Load control 515 provides instructions for a program counter 540 , which operates much like the fetch address for the control store.
  • a last-in first-out stack 544 of three registers is copied to the first register set without undergoing other operations in this phase.
  • a load control 517 for a debug address 548 is optionally included, which allows correction of errors that
  • FIG. 15B depicts the second microprocessor phase 560 , which includes reading addresses and data out of the RAM file register 533 .
  • a scratch SRAM 565 is written from SRAM address and data register 520 of the first register set, which includes a register that passes through the first two phases to be incremented in the third.
  • the scratch SRAM 565 is read by the instruction decoder and operand multiplexer 498 , as are most of the registers from the first register set, with the exception of the stack 544 , debug address 548 and SRAM address and data register mentioned above.
  • the instruction decoder and operand multiplexer 498 looks at the various registers of set 490 and SRAM 565 , decodes the instructions and gathers the operands for operation in the next phase, in particular determining the operands to provide to the ALU 602 below.
  • the outcome of the instruction decoder and operand multiplexer 498 is stored to a number of registers in the second register set 496 , including ALU operands 579 and 582 , ALU condition code register 580 , and a queue channel and command 587 register, which in this embodiment can control thirty-two queues.
  • registers in set 496 are loaded fairly directly from the instruction register 535 above without substantial decoding by the decoder 498 , including a program control 590 , a literal field 589 , a test select 584 and a flag select 585 .
  • Other registers such as the file context 522 of the first phase 500 are always stored in a file context 577 of the second phase 560 , but may also be treated as an operand that is gathered by the multiplexer 572 .
  • the stack registers 544 are simply copied in stack register 594 .
  • the program counter 540 is incremented 568 in this phase and stored in register 592 .
  • Also incremented 570 is the optional debug address 548 , and a load control 575 may be fed from the pipeline 505 at this point in order to allow error control in each phase, the result stored in debug address 598 .
  • FIG. 15C depicts the third microprocessor phase 600 , which includes ALU and queue operations.
  • the ALU 602 includes an adder, priority encoders and other standard logic functions. Results of the ALU are stored in registers ALU output 618 , ALU condition codes 620 and destination operand results 622 .
  • a file context register 616 , flag select register 626 and literal field register 630 are simply copied from the previous phase 560 .
  • a test multiplexer 604 is provided to determine whether a conditional jump results in a jump, with the results stored in a test results register 624 . The test multiplexer 604 may instead be performed in the first phase 500 along with similar decisions such as fetch control 511 .
  • a stack exchange 608 shifts a stack up or down by fetching a program counter from stack 594 or putting a program counter onto that stack, results of which are stored in program control 634 , program counter 638 and stack 640 registers.
  • the SRAM address may optionally be incremented in this phase 600 .
  • Another load control 610 for another debug address 642 may be forced from the pipeline 505 at this point in order to allow error control in this phase also.
  • a QRAM & QALU 606 shown together in this figure, read from the queue channel and command register 587 , store in SRAM and rearrange queues, adding or removing data and pointers as needed to manage the queues of data, sending results to the test multiplexer 604 and a queue flags and queue address register 628 .
  • the QRAM & QALU 606 assume the duties of managing queues for the three processors, a task conventionally performed sequentially by software on a CPU, the queue manager 606 instead providing accelerated and substantially parallel hardware queuing.
  • FIG. 16 depicts two of the thirty-two hardware queues that are managed by the queue manager 606 , with each of the queues having an SRAM head, an SRAM tail and the ability to queue information in a DRAM body as well, allowing expansion and individual configuration of each queue.
  • FIFO 700 has SRAM storage units, 705 , 707 , 709 and 711 , each containing eight bytes for a total of thirty-two bytes, although the number and capacity of these units may vary in other embodiments.
  • FIFO 702 has SRAM storage units 713 , 715 , 717 and 719 .
  • SRAM units 705 and 707 are the head of FIFO 700 and units 709 and 711 are the tail of that FIFO, while units 713 and 715 are the head of FIFO 702 and units 717 and 719 are the tail of that FIFO.
  • Information for FIFO 700 may be written into head units 705 or 707 , as shown by arrow 722 , and read from tail units 711 or 709 , as shown by arrow 725 .
  • a particular entry may be both written to and read from head units 705 or 707 , or may be both written to and read from tail units 709 or 711 , minimizing data movement and latency.
  • information for FIFO 702 is typically written into head units 713 or 715 , as shown by arrow 733 , and read from tail units 717 or 719 , as shown by arrow 739 , but may instead be read from the same head or tail unit to which it was written.
  • the SRAM FIFOS 700 and 702 are both connected to DRAM 460 , which allows virtually unlimited expansion of those FIFOS to handle situations in which the SRAM head and tail are full.
  • a first of the thirty-two queues, labeled Q-zero may queue an entry in DRAM 460 , as shown by arrow 727 , by DMA units acting under direction of the queue manager, instead of being queued in the head or tail of FIFO 700 .
  • Entries stored in DRAM 460 return to SRAM unit 709 , as shown by arrow 730 , extending the length and fall-through time of that FIFO. Diversion from SRAM to DRAM is typically reserved for when the SRAM is full, since DRAM is slower and DMA movement causes additional latency.
  • Q-zero may comprise the entries stored by queue manager 606 in both the FIFO 700 and the DRAM 460 .
  • information bound for FIFO 702 which may correspond to Q-twenty-seven, for example, can be moved by DMA into DRAM 460 , as shown by arrow 735 .
  • the capacity for queuing in cost-effective albeit slower DRAM 460 is user-definable during initialization, allowing the queues to change in size as desired.
  • Information queued in DRAM 460 is returned to SRAM unit 717 , as shown by arrow 737 .
  • Status for each of the thirty-two hardware queues is conveniently maintained in and accessed from a set 740 of four, thirty-two bit registers, as shown in FIG. 17, in which a specific bit in each register corresponds to a specific queue.
  • the registers are labeled Q-Out_Ready 745 , Q-In_Ready 750 , Q-Empty 755 and Q-Full 760 . If a particular bit is set in the Q-Out_Ready register 750 , the queue corresponding to that bit contains information that is ready to be read, while the setting of the same bit in the Q-In_Ready 752 register means that the queue is ready to be written.
  • Q-Out_Ready 745 contains bits zero 746 through thirty-one 748 , including bits twenty-seven 752 , twenty-eight 754 , twenty-nine 756 and thirty 758 .
  • Q-In_Ready 750 contains bits zero 762 through thirty-one 764 , including bits twenty-seven 766 , twenty-eight 768 , twenty-nine 770 and thirty 772 .
  • Q-Empty 755 contains bits zero 774 through thirty-one 776 , including bits twenty-seven 778 , twenty-eight 780 , twenty-nine 782 and thirty 784
  • Q-full 760 contains bits zero 786 through thirty-one 788 , including bits twenty-seven 790 , twenty-eight 792 , twenty-nine 794 and thirty 796 .
  • Q-zero corresponding to FIFO 700
  • Q-twenty-seven corresponding to FIFO 702
  • Q-twenty-seven is a receive buffer descriptor queue. After processing a received frame by the receive sequencer the sequencer looks to store a descriptor for the frame in Q-twenty-seven. If a location for such a descriptor is immediately available in SRAM, bit twenty-seven 766 of Q-In_Ready 750 will be set. If not, the sequencer must wait for the queue manager to initiate a DMA move from SRAM to DRAM, thereby freeing space to store the receive descriptor.
  • Requests which utilize the queues include Processor Request 802 , Transmit Sequencer Request 804 , and Receive Sequencer Request 806 .
  • Other requests for the queues are DRAM to SRAM Request 808 and SRAM to DRAM Request 810 , which operate on behalf of the queue manager in moving data back and forth between the DRAM and the SRAM head or tail of the queues. Determining which of these various requests will get to use the queue manager in the next cycle is handled by priority logic Arbiter 815 .
  • Dual ported QRAM 825 stores variables regarding each of the queues, the variables for each queue including a Head Write Pointer, Head Read Pointer, Tail Write Pointer and Tail Read Pointer corresponding to the queue's SRAM condition, and a Body Write Pointer and Body Read Pointer corresponding to the queue's DRAM condition and the queue's size.
  • the variables of QRAM 825 are fetched and modified according to the selected operation by a QALU 828 , and an SRAM Read Request 830 or an SRAM Write Request 840 may be generated.
  • the variables are updated and the updated status is stored in Status Register 822 as well as QRAM 825 .
  • the status is also fed to Arbiter 815 to signal that the operation previously requested has been fulfilled, inhibiting duplication of requests.
  • the Status Register 822 updates the four queue registers Q-Out_Ready 745 , Q-In_Ready 750 , Q-Empty 755 and Q-Full 760 to reflect the new status of the queue that was accessed.
  • SRAM Addresses 833 Similarly updated are SRAM Addresses 833 , Body Write Request 835 and Body Read Requests 838 , which are accessed via DMA to and from SRAM head and tails for that queue.
  • various processes may wish to write to a queue, as shown by Q Write Data 844 , which are selected by multiplexor 846 , and pipelined to SRAM Write Request 840 .
  • the SRAM controller services the read and write requests by writing the tail or reading the head of the accessed queue and returning an acknowledge. In this manner the various queues are utilized and their status updated.
  • FIGS. 19A-C show a least-recently-used register 900 that is employed for choosing which contexts or CCBs to maintain in INIC cache memory.
  • the INIC in this embodiment can cache up to sixteen CCBs in SRAM at a given time, and so when a new CCB is cached an old one must often be discarded, the discarded CCB usually chosen according to this register 900 to be the CCB that has been used least recently.
  • a hash table for up to two hundred fifty-six CCBs is also maintained in SRAM, while up to two hundred fifty-six full CCBs are held in DRAM.
  • the least-recently-used register 900 contains sixteen four-bit blocks labeled R 0 -R 15 , each of which corresponds to an SRAM cache unit. Upon initialization, the blocks are numbered 0-15, with number 0 arbitrarily stored in the block representing the least recently used (LRU) cache unit and number 15 stored in the block representing the most recently used (MRU) cache unit.
  • FIG. 19A shows the register 900 at an arbitrary time when the LRU block R 0 holds the number 9 and the MRU block R 15 holds the number 6.
  • the LRU block R 0 is read, which in FIG. 19A holds the number 9, and the new CCB is stored in the SRAM cache unit corresponding to number 9. Since the new CCB corresponding to number 9 is now the most recently used CCB, the number 9 is stored in the MRU block, as shown in FIG. 19 B. The other numbers are all shifted one register block to the left, leaving the number 1 in the LRU block. The CCB that had previously been cached in the SRAM unit corresponding to number 9 has been moved to slower but more cost-effective DRAM.
  • FIG. 19C shows the result when the next CCB used had already been cached in SRAM.
  • the CCB was cached in an SRAM unit corresponding to number 10, and so after employment of that CCB, number 10 is stored in the MRU block. Only those numbers which had previously been more recently used than number 10 (register blocks R 9 -R 15 ) are shifted to the left, leaving the number 1 in the LRU block. In this manner the INIC maintains the most active CCBs in SRAM cache.
  • a CCB being used is one that is not desirable to hold in the limited cache memory. For example, it is preferable not to cache a CCB for a context that is known to be closing, so that other cached CCBs can remain in SRAM longer.
  • the number representing the cache unit holding the decacheable CCB is stored in the LRU block R 0 rather than the MRU block R 15 , so that the decacheable CCB will be replaced immediately upon employment of a new CCB that is cached in the SRAM unit corresponding to the number held in the LRU block R 0 .
  • FIG. 19D shows the case for which number 8 (which had been in block R 9 in FIG.
  • 19C corresponds to a CCB that will be used and then closed.
  • number 8 has been removed from block R 9 and stored in the LRU block R 0 . All the numbers that had previously been stored to the left of block R 9 (R 1 -R 8 ) are then shifted one block to the right.
  • FIG. 20 shows some of the logical units employed to operate the least-recently-used register 900 .
  • An array of sixteen, three or four input multiplexors 910 of which only multiplexors MUX 0 , MUX 7 , MUX 8 , MUX 9 and MUX 15 are shown for clarity, have outputs fed into the corresponding sixteen blocks of least-recently-used register 900 .
  • the output of MUX 0 is stored in block R 0
  • the output of MUX 7 is stored in block R 7
  • the value of each of the register blocks is connected to an input for its corresponding multiplexor and also into inputs for both adjacent multiplexors, for use in shifting the block numbers.
  • the number stored in R 8 is fed into inputs for MUX 7 , MUX 8 and MUX 9 .
  • MUX 0 and MUX 15 each have only one adjacent block, and the extra input for those multiplexors is used for the selection of LRU and MRU blocks, respectively.
  • MUX 15 is shown as a four-input multiplexor, with input 915 providing the number stored on R 0 .
  • An array of sixteen comparators 920 each receives the value stored in the corresponding block of the least-recently-used register 900 .
  • Each comparator also receives a signal from processor 470 along line 935 so that the register block having a number matching that sent by processor 470 outputs true to logic circuits 930 while the other fifteen comparators output false.
  • Logic circuits 930 control a pair of select lines leading to each of the multiplexors, for selecting inputs to the multiplexors and therefore controlling shifting of the register block numbers.
  • select lines 939 control MUX 0
  • select lines 944 control MUX 7
  • select lines 949 control MUX 8 select lines 954 control MUX 9 and select lines 959 control MUX 15 .
  • processor 470 checks to see whether the CCB matches a CCB currently held in one of the sixteen cache units. If a match is found, the processor sends a signal along line 935 with the block number corresponding to that cache unit, for example number 12. Comparators 920 compare the signal from that line 935 with the block numbers and comparator C 8 provides a true output for the block R 8 that matches the signal, while all the other comparators output false. Logic circuits 930 , under control from the processor 470 , use select lines 959 to choose the input from line 935 for MUX 15 , storing the number 12 in the MRU block R 15 .
  • Logic circuits 930 also send signals along the pairs of select lines for MUX 8 and higher multiplexors, aside from MUX 15 , to shift their output one block to the left, by selecting as inputs to each multiplexor MUX 8 and higher the value that had been stored in register blocks one block to the right (R 9 -R 15 ).
  • the outputs of multiplexors that are to the left of MUX 8 are selected to be constant.
  • processor 470 If processor 470 does not find a match for the CCB among the sixteen cache units, on the other hand, the processor reads from LRU block R 0 along line 966 to identify the cache corresponding to the LRU block, and writes the data stored in that cache to DRAM.
  • the number that was stored in R 0 in this case number 3, is chosen by select lines 959 as input 915 to MUX 15 for storage in MRU block R 15 .
  • the other fifteen multiplexors output to their respective register blocks the numbers that had been stored each register block immediately to the right.
  • the LRU block R 0 rather than the MRU block R 15 is selected for placement of the number corresponding to the cache unit holding that CCB.
  • the number corresponding to the CCB to be placed in the LRU block R 0 for removal from SRAM (for example number 1, held in block R 9 ) is sent by processor 470 along line 935 , which is matched by comparator C 9 .
  • the processor instructs logic circuits 930 to input the number 1 to R 0 , by selecting with lines 939 input 935 to MUX 0 .
  • Select lines 954 to MUX 9 choose as input the number held in register block R 8 , so that the number from R 8 is stored in R 9 .
  • FIG. 21 is another diagram of Intelligent Network Interface Card (INIC) 200 of FIG. 13 .
  • INIC card 200 includes a Physical Layer Interface (PHY) chip 2100 , ASIC chip 400 and Dynamic Random Access Memory (DRAM) 460 .
  • PHY chip 2100 couples INIC card 200 to network line 210 via a network connector 2101 .
  • INIC card 200 is coupled to the CPU of the host (for example, CPU 28 of host 20 of FIG. 1) via card edge connector 2107 and PCI bus 257 .
  • ASIC chip 400 includes a Media Access Control (MAC) unit 402 , a sequencers block 2103 , SRAM control 442 , SRAM 440 , DRAM control 450 , a queue manager 2103 , a processor 470 , and a PCI bus interface unit 468 .
  • MAC Media Access Control
  • Sequencers block 2102 includes a transmit sequencer 2104 , a receive sequencer 2105 , and configuration registers 2106 .
  • a MAC destination address is stored in configuration register 2106 .
  • Part of the program code executed by processor 470 is contained in ROM (not shown) and part is located in a writeable control store SRAM (not shown). The program is downloaded into the writeable control store SRAM at initialization from the host 20 .
  • FIG. 22 is a more detailed diagram of receive sequencer 2105 .
  • Receive sequencer 2105 includes a data synchronization buffer 2200 , a packet synchronization sequencer 2201 , a data assembly register 2202 , a protocol analyzer 2203 , a packet processing sequencer 2204 , a queue manager interface 2205 , and a Direct Memory Access (DMA) control block 2206 .
  • the packet synchronization sequencer 2201 and data synchronization buffer 2200 utilize a network-synchronized clock of MAC 402 , whereas the remainder of the receive sequencer 2105 utilizes a fixed-frequency clock.
  • Dashed line 2221 indicates the clock domain boundary.
  • CD Appendix A contains a complete hardware description (verilog code) of an embodiment of receive sequencer 2105 . Signals in the verilog code are named to designate their functions. Individual sections of the verilog code are identified and labeled with comment lines. Each of these sections describes hardware in a block of the receive sequencer 2105 as set forth below in Table 1.
  • DramBuffer 2206 Fly-By Protocol Analyzer Frame, Network 2203 and Transport Layers Link Pointer 2203 Mac address detection 2203 Magic pattern detection 2203 Link layer and network layer detection 2203 Network counter 2203 Control Packet analysis 2203 Network header analysis 2203 Transport layer counter 2203 Transport header analysis 2203 Pseudo-header stuff 2203 Free-Descriptor Fetch 2205 Receive-Descriptor Store 2205 Receive-Vector Store 2205 Queue-manager interface-mux 2205 Pause Clock Generator 2201 Pause Timer 2204
  • processor 470 partitions DRAM 460 into buffers.
  • Receive sequencer 2105 uses the buffers in DRAM 460 to store incoming network packet data as well as status information for the packet.
  • Processor 470 creates a 32-bit buffer descriptor for each buffer.
  • a buffer descriptor indicates the size and location in DRAM of its associated buffer.
  • Processor 470 places these buffer descriptors on a “free-buffer queue” 2108 by writing the descriptors to the queue manager 2103 .
  • Queue manager 2103 maintains multiple queues including the “free-buffer queue” 2108 .
  • the heads and tails of the various queues are located in SRAM 440 , whereas the middle portion of the queues are located in DRAM 460 .
  • Lines 2229 comprise a request mechanism involving a request line and address lines.
  • lines 2230 comprise a request mechanism involving a request line and address lines.
  • Queue manager 2103 uses lines 2229 and 2230 to issue requests to transfer queue information from DRAM to SRAM or from SRAM to DRAM.
  • the queue manager interface 2205 of the receive sequencer always attempts to maintain a free buffer descriptor 2207 for use by the packet processing sequencer 2204 .
  • Bit 2208 is a ready bit that indicates that free-buffer descriptor 2207 is available for use by the packet processing sequencer 2204 . If queue manager interface 2205 does not have a free buffer descriptor (bit 2208 is not set), then queue manager interface 2205 requests one from queue manager 2103 via request line 2209 . (Request line 2209 is actually a bus which communicates the request, a queue ID, a read/write signal and data if the operation is a write to the queue.)
  • queue manager 2103 retrieves a free buffer descriptor from the tail of the “free buffer queue” 2108 and then alerts the queue manager interface 2205 via an acknowledge signal on acknowledge line 2210 .
  • the queue manager interface 2205 receives the acknowledge signal, the queue manager interface 2205 loads the free buffer descriptor 2207 and sets the ready bit 2208 . Because the free buffer descriptor was in the tail of the free buffer queue in SRAM 440 , the queue manager interface 2205 actually receives the free buffer descriptor 2207 from the read data bus 2228 of the SRAM control block 442 .
  • Packet processing sequencer 2204 requests a free buffer descriptor 2207 via request line 2211 .
  • the queue manager interface 2205 When the queue manager interface 2205 retrieves the free buffer descriptor 2207 and the free buffer descriptor 2207 is available for use by the packet processing sequencer, the queue manager interface 2205 informs the packet processing sequencer 2204 via grant line 2212 . By this process, a free buffer descriptor is made available for use by the packet processing sequencer 2204 and the receive sequencer 2105 is ready to processes an incoming packet.
  • a TCP/IP packet is received from the network line 210 via network connector 2101 and Physical Layer Interface (PHY) 2100 .
  • PHY 2100 supplies the packet to MAC 402 via a Media Independent Interface (MII) parallel bus 2109 .
  • MII Media Independent Interface
  • MAC 402 begins processing the packet and asserts a “start of packet” signal on line 2213 indicating that the beginning of a packet is being received.
  • MII Media Independent Interface
  • MAC 402 asserts a “data valid” signal on line 2214 .
  • the packet synchronization sequencer 2201 instructs the data synchronization buffer 2200 via load signal line 2222 to load the received byte from data lines 2215 .
  • Data synchronization buffer 2200 is four bytes deep.
  • the packet synchronization sequencer 2201 increments a data synchronization buffer write pointer.
  • This data synchronization buffer write pointer is made available to the packet processing sequencer 2204 via lines 2216 . Consecutive bytes of data from data lines 2215 are clocked into the data synchronization buffer 2200 in this way.
  • a data synchronization buffer read pointer available on lines 2219 is maintained by the packet processing sequencer 2204 .
  • the packet processing sequencer 2204 determines that data is available in data synchronization buffer 2200 by comparing the data synchronization buffer write pointer on lines 2216 with the data synchronization buffer read pointer on lines 2219 .
  • Data assembly register 2202 contains a sixteen-byte long shift register 2217 .
  • This register 2217 is loaded serially a single byte at a time and is unloaded in parallel.
  • a write pointer is incremented. This write pointer is made available to the packet processing sequencer 2204 via lines 2218 .
  • a read pointer maintained by packet processing sequencer 2204 is incremented. This read pointer is available to the data assembly register 2202 via lines 2220 .
  • the packet processing sequencer 2204 can therefore determine whether room is available in register 2217 by comparing the write pointer on lines 2218 to the read pointer on lines 2220 .
  • packet processing sequencer 2204 determines that room is available in register 2217 . If the packet processing sequencer 2204 determines that room is available in register 2217 , then packet processing sequencer 2204 instructs data assembly register 2202 to load a byte of data from data synchronization buffer 2200 .
  • the data assembly register 2202 increments the data assembly register write pointer on lines 2218 and the packet processing sequencer 2204 increments the data synchronization buffer read pointer on lines 2219 .
  • Data shifted into register 2217 is examined at the register outputs by protocol analyzer 2203 which verifies checksums, and generates “status” information 2223 .
  • DMA control block 2206 is responsible for moving information from register 2217 to buffer 2114 via a sixty-four byte receive FIFO 2110 .
  • DMA control block 2206 implements receive FIFO 2110 as two thirty-two byte ping-pong buffers using sixty-four bytes of SRAM 440 .
  • DMA control block 2206 implements the receive FIFO using a write-pointer and a read-pointer.
  • DMA control block 2206 asserts an SRAM write request to SRAM controller 442 via lines 2225 .
  • SRAM controller 442 in turn moves data from register 2217 to FIFO 2110 and asserts an acknowledge signal back to DMA control block 2206 via lines 2225 .
  • DMA control block 2206 then increments the receive FIFO write pointer and causes the data assembly register read pointer to be incremented.
  • DMA control block 2206 presents a DRAM write request to DRAM controller 450 via lines 2226 .
  • This write request consists of the free buffer descriptor 2207 ORed with a “buffer load count” for the DRAM request address, and the receive FIFO read pointer for the SRAM read address.
  • the DRAM controller 450 asserts a read request to SRAM controller 442 .
  • SRAM controller 442 responds to DRAM controller 450 by returning the indicated data from the receive FIFO 2110 in SRAM 440 and asserting an acknowledge signal.
  • DRAM controller 450 stores the data in a DRAM write data register, stores a DRAM request address in a DRAM address register, and asserts an acknowledge to DMA control block 2206 .
  • the DMA control block 2206 then decrements the receive FIFO read pointer. Then the DRAM controller 450 moves the data from the DRAM write data register to buffer 2114 .
  • DRAM control block 2206 moves those thirty-two byte chunks of data one at a time from SRAM 440 to buffer 2214 in DRAM 460 . Transferring thirty-two byte chunks of data to the DRAM 460 in this fashion allows data to be written into the DRAM using the relatively efficient burst mode of the DRAM.
  • Packet data continues to flow from network line 210 to buffer 2114 until all packet data has been received.
  • MAC 402 indicates that the incoming packet has completed by asserting an “end of frame” (i.e., end of packet) signal on line 2227 and by presenting final packet status (MAC packet status) to packet synchronization sequencer 2204 .
  • the packet processing sequencer 2204 then moves the status 2223 (also called “protocol analyzer status”) and the MAC packet status to register 2217 for eventual transfer to buffer 2114 .
  • status 2223 and the MAC packet status is transferred to buffer 2214 so that it is stored prepended to the associated data as shown in FIG. 22 .
  • packet processing sequencer 2204 creates a summary 2224 (also called a “receive packet descriptor”) by concatenating the free buffer descriptor 2207 , the buffer load-count, the MAC ID, and a status bit (also called an “attention bit”). If the attention bit is a one, then the packet is not a “fast-path candidate”; whereas if the attention bit is a zero, then the packet is a “fast-path candidate”. The value of the attention bit represents the result of a significant amount of processing that processor 470 would otherwise have to do to determine whether the packet is a “fast-path candidate”. For example, the attention bit being a zero indicates that the packet employs both TCP protocol and IP protocol.
  • Packet processing sequencer 2204 then sets a ready bit (not shown) associated with summary 2224 and presents summary 2224 to queue manager interface 2205 .
  • Queue manager interface 2205 then requests a write to the head of a “summary queue” 2112 (also called the “receive descriptor queue”).
  • the queue manager 2103 receives the request, writes the summary 2224 to the head of the summary queue 2212 , and asserts an acknowledge signal back to queue manager interface via line 2210 .
  • queue manager interface 2205 informs packet processing sequencer 2204 that the summary 2224 is in summary queue 2212 by clearing the ready bit associated with the summary.
  • Packet processing sequencer 2204 also generates additional status information (also called a “vector”) for the packet by concatenating the MAC packet status and the MAC ID. Packet processing sequencer 2204 sets a ready bit (not shown) associated with this vector and presents this vector to the queue manager interface 2205 . The queue manager interface 2205 and the queue manager 2103 then cooperate to write this vector to the head of a “vector queue” 2113 in similar fashion to the way summary 2224 was written to the head of summary queue 2112 as described above. When the vector for the packet has been written to vector queue 2113 , queue manager interface 2205 resets the ready bit associated with the vector.
  • additional status information also called a “vector”
  • processor 470 can retrieve summary 2224 from summary queue 2112 and examine the “attention bit”.
  • processor 470 determines that the packet is not a “fast-path candidate” and processor 470 need not examine the packet headers. Only the status 2223 (first sixteen bytes) from buffer 2114 are DMA transferred to SRAM so processor 470 can examine it. If the status 2223 indicates that the packet is a type of packet that is not to be transferred to the host (for example, a multicast frame that the host is not registered to receive), then the packet is discarded (i.e., not passed to the host).
  • processor 470 determines that the packet is a “fast-path candidate”. If processor 470 determines that the packet is a “fast-path candidate”, then processor 470 uses the buffer descriptor from the summary to DMA transfer the first approximately 96 bytes of information from buffer 2114 from DRAM 460 into a portion of SRAM 440 so processor 470 can examine it. This first approximately 96 bytes contains status 2223 as well as the IP source address of the IP header, the IP destination address of the IP header, the TCP source address of the TCP header, and the TCP destination address of the TCP header.
  • IP source address of the IP header, the IP destination address of the IP header, the TCP source address of the TCP header, and the TCP destination address of the TCP header together uniquely define a single connection context (TCB) with which the packet is associated.
  • Processor 470 examines these addresses of the TCP and IP headers and determines the connection context of the packet. Processor 470 then checks a list of connection contexts that are under the control on INIC card 200 and determines whether the packet is associated with a connection context (TCB) under the control of INIC card 200 .
  • TCP connection context
  • connection context is not in the list, then the “fast-path candidate” packet is determined not to be a “fast-path packet.” In such a case, the entire packet (headers and data) is transferred to a buffer in host 20 for “slow-path” processing by the protocol stack of host 20 .
  • connection context is in the list, then software executed by processor 470 including software state machines 2231 and 2232 checks for one of numerous exception conditions and determines whether the packet is a “fast-path packet” or is not a “fast-path packet”.
  • exception conditions include: 1) IP fragmentation is detected; 2) an IP option is detected; 3) an unexpected TCP flag (urgent bit set, reset bit set, SYN bit set or FIN bit set) is detected; 4) the ACK field in the TCP header is before the TCP window, or the ACK field in the TCP header is after the TCP window, or the ACK field in the TCP header shrinks the TCP window; 5) the ACK field in the TCP header is a duplicate ACK and the ACK field exceeds the duplicate ACK count (the duplicate ACK count is a user settable value); and 6) the sequence number of the TCP header is out of order (packet is received out of sequence).
  • processor 470 determines that the “fast-path candidate” is not a “fast-path packet.” In such a case, the connection context for the packet is “flushed” (the connection context is passed back to the host) so that the connection context is no longer present in the list of connection contexts under control of INIC card 200 . The entire packet (headers and data) is transferred to a buffer in host 20 for “slow-path” transport layer and network layer processing by the protocol stack of host 20 .
  • processor 470 finds no such exception condition, then the “fast-path candidate” packet is determined to be an actual “fast-path packet”.
  • the receive state machine 2232 then processes of the packet through TCP.
  • the data portion of the packet in buffer 2114 is then transferred by another DMA controller (not shown in FIG. 21) from buffer 2114 to a host-allocated file cache in storage 35 of host 20 .
  • host 20 does no analysis of the TCP and IP headers of a “fast-path packet”. All analysis of the TCP and IP headers of a “fast-path packet” is done on INIC card 20 .
  • FIG. 23 is a diagram illustrating the transfer of data of “fast-path packets” (packets of a 64 k-byte session layer message 2300 ) from INIC 200 to host 20 .
  • the portion of the diagram to the left of the dashed line 2301 represents INIC 200
  • the portion of the diagram to the right of the dashed line 2301 represents host 20 .
  • the 64 k-byte session layer message 2300 includes approximately forty-five packets, four of which ( 2302 , 2303 , 2304 and 2305 ) are labeled on FIG. 23 .
  • the first packet 2302 includes a portion 2306 containing transport and network layer headers (for example, TCP and IP headers), a portion 2307 containing a session layer header, and a portion 2308 containing data.
  • transport and network layer headers for example, TCP and IP headers
  • portion 2307 , the first few bytes of data from portion 2308 , and the connection context identifier 2310 of the packet 2300 are transferred from INIC 200 to a 256-byte buffer 2309 in host 20 .
  • host 20 examines this information and returns to INIC 200 a destination (for example, the location of a file cache 2311 in storage 35 ) for the data.
  • Host 20 also copies the first few bytes of the data from buffer 2309 to the beginning of a first part 2312 of file cache 2311 .
  • INIC 200 transfers the remainder of the data from portion 2308 to host 20 such that the remainder of the data is stored in the remainder of first part 2312 of file cache 2311 .
  • No network, transport, or session layer headers are stored in first part 2312 of file cache 2311 .
  • the data portion 2313 of the second packet 2303 is transferred to host 20 such that the data portion 2313 of the second packet 2303 is stored in a second part 2314 of file cache 2311 .
  • the transport layer and network layer header portion 2315 of second packet 2303 is not transferred to host 20 .
  • the data portion 2316 of the next packet 2304 of the session layer message is transferred to file cache 2311 so that there is no network, transport, or session layer headers between the data portion of the second packet 2303 and the data portion of the third packet 2304 in file cache 2311 .
  • the data from the session layer message 2300 is present in file cache 2311 as a block such that this block contains no network, transport, or session layer headers.
  • portions 2307 and 2308 of the session layer message are transferred to 256-byte buffer 2309 of host 20 along with the connection context identifier 2310 as in the case of the longer session layer message described above.
  • the transfer is completed at this point.
  • Host 20 does not return a destination to INIC 200 and INIC 200 does not transfer subsequent data to such a destination.
  • CD Appendix B includes a listing of software executed by processor 470 that determines whether a “fast-path candidate” packet is or is not a “fast-path packet”.
  • An example of the instruction set of processor 470 is found starting on page 79 of the Provisional U.S. Patent Application Ser. No. 60/061,809, entitled “Intelligent Network Interface Card And System For Protocol Processing”, filed Oct. 14, 1997 (the subject matter of this provisional application is incorporated herein by reference).
  • CD Appendix C includes device driver software executable on host 20 that interfaces the host 20 to INIC card 200 .
  • ATCP code that executes on host 20 .
  • This ATCP code includes: 1) a “free BSD” stack (available from the University of California, Berkeley) that has been modified slightly to make it run on the NT4 operating system (the “free BSD” stack normally runs on a UNIX machine), and 2) code added to the free BSD stack between the session layer above and the device driver below that enables the BSD stack to carry out “fast-path” processing in conjunction with INIC 200 .
  • TRANSMIT FAST-PATH PROCESSING The following is an overview of one embodiment of a transmit fast-path flow once a command has been posted (for additional information, see provisional application 60/098,296, filed Aug. 27, 1998).
  • the transmit request may be a segment that is less than the MSS, or it may be as much as a full 64 K session layer packet.
  • the former request will go out as one segment, the latter as a number of MSS-sized segments.
  • the transmitting CCB must hold on to the request until all data in it has been transmitted and ACKed. Appropriate pointers to do this are kept in the CCB.
  • To create an output TCP/IP segment a large DRAM buffer is acquired from the Q_FREEL queue.
  • data is DMAd from host memory into the DRAM buffer to create an MSS-sized segment.
  • This DMA also checksums the data.
  • the TCP/IP header is created in SRAM and DMAd to the front of the payload data. It is quicker and simpler to keep a basic frame header (i.e., a template header) permanently in the CCB and DMA this directly from the SRAM CCB buffer into the DRAM buffer each time.
  • the payload checksum is adjusted for the pseudo-header (i.e., the template header) and placed into the TCP header prior to DMAing the header from SRAM.
  • the DRAM buffer is queued to the appropriate Q_UXMT transmit queue.
  • the final step is to update various window fields etc in the CCB.
  • the INIC will place a command response in the response queue containing the command buffer from the original transmit command and appropriate status.
  • the real challenge in the transmit processor is to determine whether it is appropriate to transmit at the time a transmit request arrives, and then to continue to transmit for as long as the transport protocol permits.
  • the receiver's window size is less than or equal to zero, the persist timer has expired, the amount to send is less than a full segment and an ACK is expected/outstanding, the receiver's window is not half-open, etc.
  • Much of transmit processing will be in determining these conditions.
  • the fast-path is implemented as a finite state machine (FSM) that covers at least three layers of the protocol stack, i.e., IP, TCP, and Session.
  • FSM finite state machine
  • EX_SCMD send command
  • Each event and state intersection provides an action to be executed and a new state.
  • the following is an example of the state/event transition, the action to be executed and the new state for the SEND command while in transmit state IDLE (SX_IDLE).
  • the action from this state/event intersection is AX_NUCMD and the next state is XMIT COMMAND ACTIVE (SX_XMIT).
  • a command to transmit data has been received while transmit is currently idle. The action performs the following steps: 1) Store details of the command into the CCB. 2) Check that it is okay to transmit now (e.g. send window is not zero). 3) If output is not possible, send the Check Output event to Q_EVENT1 queue for the Transmit CCB's FSM and exit.
  • Transmit FSM Transmit software state machine 2231 of FIG. 21
  • fast-path transmit processing is controlled using write only transmit configuration register (XmtCfg).
  • Register XmtCfg has the following portions: 1) Bit 31 (name: Reset). Writing a one (1) will force reset asserted to the transmit sequencer of the channel selected by XcvSel. 2) Bit 30 (name: XmtEn). Writing a one (1) allows the transmit sequencer to run. Writing a zero (0) causes the transmit sequencer to halt after completion of the current packet. 3) Bit 29 (name: PauseEn).
  • Bit 28 (name: LoadRng). Writing a one (1) causes the data in RcvAddrB[10:00] to be loaded in to the Mac's random number register for use during collision back-offs. 5) Bits 27 : 20 (name: Reserved). 6) Bits 19 : 15 (name: FreeQId). Selects the queue to which the freed buffer descriptors will be written once the packet transmission has been terminated, either successfully or unsuccessfully. 7) Bits 14 : 10 (name: XmtQId).
  • transmit sequencer 2104 of FIG. 21 retrieves buffer descriptors from two transmit queues, one of the queues having a higher transmission priority than the other.
  • the higher transmission priority transmit queue is used for the transmission of TCP ACKs, whereas the lower transmission priority transmit queue is used for the transmission of other types of packets.
  • ACKs may be transmitted in accordance with techniques set forth in U.S. patent application Ser. No. 09/802,426 (the subject matter of which is incorporated herein by reference).
  • the processor that executes the Transmit FSM, the receive and transmit sequencers, and the host processor that executes the protocol stack are all realized on the same printed circuit board.
  • the printed circuit board may, for example, be a card adapted for coupling to another computer.
  • Protocol processing speed and efficiency is tremendously accelerated by specially designed protocol processing hardware as compared with a general purpose CPU running conventional protocol software, and interrupts to the host CPU are also substantially reduced.
  • INIC intelligent network interface card
  • the protocol processing hardware and CPU intelligently decide which device processes a given message, and can change the allocation of that processing based upon conditions of the message.

Abstract

A network interface device provides a fast-path that avoids most host TCP and IP protocol processing for most messages. The host retains a fallback slow-path processing capability. In one embodiment, generation of a response to a TCP/IP packet received onto the network interface device is accelerated by determining the TCP and IP source and destination information from the incoming packet, retrieving an appropriate template header, using a finite state machine to fill in the TCP and IP fields in the template header without sequential TCP and IP protocol processing, combining the filled-in template header with a data payload to form a packet, and then outputting the packet from the network interface device by pushing a pointer to the packet onto a transmit queue. A transmit sequencer retrieves the pointer from the transmit queue and causes the corresponding packet to be output from the network interface device.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a c-i-p under 35 U.S.C. §120 of U.S. patent application Ser. No. 10/023,240, entitled “TRANSMIT FAST-PATH PROCESSING ON TCP/IP OFFLOAD NETWORK INTERFACE DEVICE,” filed Dec. 17, 2001, by Laurence B. Boucher et al., and is a c-i-p under 35 U.S.C. §120 of U.S. patent application Ser. No. 09/464,283 entitled “INTELLIGENT NETWORK INTERFACE DEVICE AND SYSTEM FOR ACCELERATED COMMUNICATION”, filed Dec. 15, 1999, by Laurence B. Boucher et al., now U.S. Pat. No. 6,427,173, which in turn is a c-i-p under 35 U.S.C. §120 of U.S. patent application Ser. No. 09/439,603, entitled “INTELLIGENT NETWORK INTERFACE SYSTEM AND METHOD FOR ACCELERATED PROTOCOL PROCESSING”, filed Nov. 12, 1999, by Laurence B. Boucher et al., now U.S. Pat. No. 6,247,060, which in turn is a c-i-p under 35 U.S.C. §120 of U.S. patent application Ser. No. 09/067,544, entitled “INTELLIGENT NETWORK INTERFACE SYSTEM AND METHOD FOR ACCELERATED PROTOCOL PROCESSING”, filed Apr. 27, 1998, now U.S. Pat. No. 6,226,680 which in turn claims the benefit under 35 U.S.C. §119(e)(1) of the Provisional Application filed under 35 U.S.C. §111(b) entitled “INTELLIGENT NETWORK INTERFACE CARD AND SYSTEM FOR PROTOCOL PROCESSING,” Ser. No. 60/061,809, filed on Oct. 14, 1997.
This application also is a c-i-p under 35 U.S.C. §120 of U.S. patent application Ser. No. 09/384,792, entitled “INTELLIGENT NETWORK INTERFACE DEVICE AND SYSTEM FOR ACCELERATED COMMUNICATION,” filed Aug. 27, 1999, now U.S. Pat. No. 6,434,620 and is a c-i-p under 35 U.S.C. §120 of U.S. patent application Ser. No. 09/141,713, entitled “INTELLIGENT NETWORK INTERFACE DEVICE AND SYSTEM FOR ACCELERATED PROTOCOL PROCESSING”, filed Aug. 28, 1998, now U.S. Pat. No. 6,389,479 which both claim the benefit under 35 U.S.C. §119(e)(1) of the Provisional Application filed under 35 U.S.C. §111(b) entitled “INTELLIGENT NETWORK INTERFACE DEVICE AND SYSTEM FOR ACCELERATED COMMUNICATION,” Ser. No. 60/098,296, filed Aug. 27, 1998.
This application also is a c-i-p under 35 U.S.C. §120 of U.S. patent application Ser. No. 09/416,925, entitled “QUEUE SYSTEM FOR MICROPROCESSORS,” filed Oct. 13, 1999, now U.S. Pat. No. 6,470,415 U.S. patent application Ser. No. 09/514,425, entitled “PROTOCOL PROCESSING STACK FOR USE WITH INTELLIGENT NETWORK INTERFACE CARD,” filed Feb. 28, 2000, now U.S. Pat. No. 6,427,171 U.S. patent application Ser. No. 09/675,484, entitled “INTELLIGENT NETWORK STORAGE INTERFACE SYSTEM,” filed Sep. 29, 2000, U.S. patent application Ser. No. 09/675,700, entitled “INTELLIGENT NETWORK STORAGE INTERFACE DEVICE,” filed Sep. 29, 2000, U.S. patent application Ser. No. 09/789,366, entitled “OBTAINING A DESTINATION ADDRESS SO THAT A NETWORK INTERFACE DEVICE CAN WRITE NETWORK DATA WITHOUT HEADERS DIRECTLY INTO HOST MEMORY,” filed Feb. 20, 2001, U.S. patent application Ser. No. 09/801,488, entitled “PORT AGGREGATION FOR NETWORK CONNECTIONS THAT ARE OFFLOADED TO NETWORK INTERFACE DEVICES,” filed Mar. 7, 2001, U.S. patent application Ser. No. 09/802,551, entitled “INTELLIGENT NETWORK STORAGE INTERFACE SYSTEM,” filed Mar. 9, 2001, U.S. patent application Ser. No. 09/802,426, entitled “REDUCING DELAYS ASSOCIATED WITH INSERTING A CHECKSUM INTO A NETWORK MESSAGE,” filed Mar. 9, 2001, U.S. patent application Ser. No. 09/802,550, entitled “INTELLIGENT INTERFACE CARD AND METHOD FOR ACCELERATED PROTOCOL PROCESSING,” filed Mar. 9, 2001, U.S. patent application Ser. No. 09/855,979, entitled “NETWORK INTERFACE DEVICE EMPLOYING DMA COMMAND QUEUE,” filed May. 14, 2001, U.S. patent application Ser. No. 09/970,124, entitled “NETWORK INTERFACE DEVICE THAT FAST-PATH PROCESSES SOLICITED SESSION LAYER READ COMMANDS,” filed Oct. 2, 2001.
The subject matter of all of the above-identified patent applications (including the subject matter in the Microfiche Appendix of U.S. application Ser. No. 09/464,283, now U.S. Pat. No. 6,427,173), and of the two above-identified provisional applications, is incorporated by reference herein.
REFERENCE TO COMPACT DISC APPENDIX
The Compact Disc Appendix (CD Appendix), which is a part of the present disclosure, includes three folders, designated CD Appendix A, CD Appendix B, and CD Appendix C on the compact disc. CD Appendix A contains a hardware description language (verilog code) description of an embodiment of a receive sequencer. CD Appendix B contains microcode executed by a processor that operates in conjunction with the receive sequencer of CD Appendix A. CD Appendix C contains a device driver executable on the host as well as ATCP code executable on the host. A portion of the disclosure of this patent document contains material (other than any portion of the “free BSD” stack included in CD Appendix C) which is subject to copyright protection. The copyright owner of that material has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights.
TECHNICAL FIELD
The present invention relates generally to computer or other networks, and more particularly to processing of information communicated between hosts such as computers connected to a network.
BACKGROUND
The advantages of network computing are increasingly evident. The convenience and efficiency of providing information, communication or computational power to individuals at their personal computer or other end user devices has led to rapid growth of such network computing, including internet as well as intranet devices and applications.
As is well known, most network computer communication is accomplished with the aid of a layered software architecture for moving information between host computers connected to the network. The layers help to segregate information into manageable segments, the general functions of each layer often based on an international standard called Open Systems Interconnection (OSI). OSI sets forth seven processing layers through which information may pass when received by a host in order to be presentable to an end user. Similarly, transmission of information from a host to the network may pass through those seven processing layers in reverse order. Each step of processing and service by a layer may include copying the processed information. Another reference model that is widely implemented, called TCP/IP (TCP stands for transport control protocol, while IP denotes internet protocol) essentially employs five of the seven layers of OSI.
Networks may include, for instance, a high-speed bus such as an Ethernet connection or an internet connection between disparate local area networks (LANs), each of which includes multiple hosts, or any of a variety of other known means for data transfer between hosts. According to the OSI standard, physical layers are connected to the network at respective hosts, the physical layers providing transmission and receipt of raw data bits via the network. A data link layer is serviced by the physical layer of each host, the data link layers providing frame division and error correction to the data received from the physical layers, as well as processing acknowledgment frames sent by the receiving host. A network layer of each host is serviced by respective data link layers, the network layers primarily controlling size and coordination of subnets of packets of data.
A transport layer is serviced by each network layer and a session layer is serviced by each transport layer within each host. Transport layers accept data from their respective session layers and split the data into smaller units for transmission to the other host's transport layer, which concatenates the data for presentation to respective presentation layers. Session layers allow for enhanced communication control between the hosts. Presentation layers are serviced by their respective session layers, the presentation layers translating between data semantics and syntax which may be peculiar to each host and standardized structures of data representation. Compression and/or encryption of data may also be accomplished at the presentation level. Application layers are serviced by respective presentation layers, the application layers translating between programs particular to individual hosts and standardized programs for presentation to either an application or an end user. The TCP/IP standard includes the lower four layers and application layers, but integrates the functions of session layers and presentation layers into adjacent layers. Generally speaking, application, presentation and session layers are defined as upper layers, while transport, network and data link layers are defined as lower layers.
The rules and conventions for each layer are called the protocol of that layer, and since the protocols and general functions of each layer are roughly equivalent in various hosts, it is useful to think of communication occurring directly between identical layers of different hosts, even though these peer layers do not directly communicate without information transferring sequentially through each layer below. Each lower layer performs a service for the layer immediately above it to help with processing the communicated information. Each layer saves the information for processing and service to the next layer. Due to the multiplicity of hardware and software architectures, devices and programs commonly employed, each layer is necessary to insure that the data can make it to the intended destination in the appropriate form, regardless of variations in hardware and software that may intervene.
In preparing data for transmission from a first to a second host, some control data is added at each layer of the first host regarding the protocol of that layer, the control data being indistinguishable from the original (payload) data for all lower layers of that host. Thus an application layer attaches an application header to the payload data and sends the combined data to the presentation layer of the sending host, which receives the combined data, operates on it and adds a presentation header to the data, resulting in another combined data packet. The data resulting from combination of payload data, application header and presentation header is then passed to the session layer, which performs required operations including attaching a session header to the data and presenting the resulting combination of data to the transport layer. This process continues as the information moves to lower layers, with a transport header, network header and data link header and trailer attached to the data at each of those layers, with each step typically including data moving and copying, before sending the data as bit packets over the network to the second host.
The receiving host generally performs the converse of the above-described process, beginning with receiving the bits from the network, as headers are removed and data processed in order from the lowest (physical) layer to the highest (application) layer before transmission to a destination of the receiving host. Each layer of the receiving host recognizes and manipulates only the headers associated with that layer, since to that layer the higher layer control data is included with and indistinguishable from the payload data. Multiple interrupts, valuable central processing unit (CPU) processing time and repeated data copies may also be necessary for the receiving host to place the data in an appropriate form at its intended destination.
The above description of layered protocol processing is simplified, as college-level textbooks devoted primarily to this subject are available, such as Computer Networks, Third Edition (1996) by Andrew S. Tanenbaum, which is incorporated herein by reference. As defined in that book, a computer network is an interconnected collection of autonomous computers, such as internet and intranet devices, including local area networks (LANs), wide area networks (WANs), asynchronous transfer mode (ATM), ring or token ring, wired, wireless, satellite or other means for providing communication capability between separate processors. A computer is defined herein to include a device having both logic and memory functions for processing data, while computers or hosts connected to a network are said to be heterogeneous if they function according to different operating devices or communicate via different architectures.
As networks grow increasingly popular and the information communicated thereby becomes increasingly complex and copious, the need for such protocol processing has increased. It is estimated that a large fraction of the processing power of a host CPU may be devoted to controlling protocol processes, diminishing the ability of that CPU to perform other tasks. Network interface cards have been developed to help with the lowest layers, such as the physical and data link layers. It is also possible to increase protocol processing speed by simply adding more processing power or CPUs according to conventional arrangements. This solution, however, is both awkward and expensive. But the complexities presented by various networks, protocols, architectures, operating devices and applications generally require extensive processing to afford communication capability between various network hosts.
SUMMARY OF THE INVENTION
The current invention provides a device for processing network communication that greatly increases the speed of that processing and the efficiency of transferring data being communicated. The invention has been achieved by questioning the long-standing practice of performing multilayered protocol processing on a general-purpose processor. The protocol processing method and architecture that results effectively collapses the layers of a connection-based, layered architecture such as TCP/IP into a single wider layer which is able to send network data more directly to and from a desired location or buffer on a host. This accelerated processing is provided to a host for both transmitting and receiving data, and so improves performance whether one or both hosts involved in an exchange of information have such a feature.
The accelerated processing includes employing representative control instructions for a given message that allow data from the message to be processed via a fast-path which accesses message data directly at its source or delivers it directly to its intended destination. This fast-path bypasses conventional protocol processing of headers that accompany the data. The fast-path employs a specialized microprocessor designed for processing network communication, avoiding the delays and pitfalls of conventional software layer processing, such as repeated copying and interrupts to the CPU. In effect, the fast-path replaces the states that are traditionally found in several layers of a conventional network stack with a single state machine encompassing all those layers, in contrast to conventional rules that require rigorous differentiation and separation of protocol layers. The host retains a sequential protocol processing stack which can be employed for setting up a fast-path connection or processing message exceptions. The specialized microprocessor and the host intelligently choose whether a given message or portion of a message is processed by the microprocessor or the host stack.
One embodiment is a method of generating a fast-path response to a packet received onto a network interface device where the packet is received over a TCP/IP network connection and where the TCP/IP network connection is identified at least in part by a TCP source port, a TCP destination port, an IP source address, and an IP destination address. The method comprises: 1) Examining the packet and determining from the packet the TCP source port, the TCP destination port, the IP source address, and the IP destination address; 2) Accessing an appropriate template header stored on the network interface device. The template header has TCP fields and IP fields; 3) Employing a finite state machine that implements both TCP protocol processing and IP protocol processing to fill in the TCP fields and IP fields of the template header; and 4) Transmitting the fast-path response from the network interface device. The fast-path response includes the filled in template header and a payload. The finite state machine does not entail a TCP protocol processing layer and a discrete IP protocol processing layer where the TCP and IP layers are executed one after another in sequence. Rather, the finite state machine covers both TCP and IP protocol processing layers.
In one embodiment, buffer descriptors that point to packets to be transmitted are pushed onto a plurality of transmit queues. A transmit sequencer pops the transmit queues and obtains the buffer descriptors. The buffer descriptors are then used to retrieve the packets from buffers where the packets are stored. The retrieved packets are then transmitted from the network interface device. In one embodiment, there are two transmit queues, one having a higher transmission priority than the other. Packets identified by buffer descriptors on the higher priority transmit queue are transmitted from the network interface device before packets identified by the lower priority transmit queue.
Other structures and methods are disclosed in the detailed description below. This summary does not purport to define the invention. The invention is defined by the claims.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a plan view diagram of a device of the present invention, including a host computer having a communication-processing device for accelerating network communication.
FIG. 2 is a diagram of information flow for the host of FIG. 1 in processing network communication, including a fast-path, a slow-path and a transfer of connection context between the fast and slow-paths.
FIG. 3 is a flow chart of message receiving according to the present invention.
FIG. 4A is a diagram of information flow for the host of FIG. 1 receiving a message packet processed by the slow-path.
FIG. 4B is a diagram of information flow for the host of FIG. 1 receiving an initial message packet processed by the fast-path.
FIG. 4C is a diagram of information flow for the host of FIG. 4B receiving a subsequent message packet processed by the fast-path.
FIG. 4D is a diagram of information flow for the host of FIG. 4C receiving a message packet having an error that causes processing to revert to the slow-path.
FIG. 5 is a diagram of information flow for the host of FIG. 1 transmitting a message by either the fast or slow-paths.
FIG. 6 is a diagram of information flow for a first embodiment of an intelligent network interface card (INIC) associated with a client having a TCP/IP processing stack.
FIG. 7 is a diagram of hardware logic for the INIC embodiment shown in FIG. 6, including a packet control sequencer and a fly-by sequencer.
FIG. 8 is a diagram of the fly-by sequencer of FIG. 7 for analyzing header bytes as they are received by the INIC.
FIG. 9 is a diagram of information flow for a second embodiment of an INIC associated with a server having a TCP/IP processing stack.
FIG. 10 is a diagram of a command driver installed in the host of FIG. 9 for creating and controlling a communication control block for the fast-path.
FIG. 11 is a diagram of the TCP/IP stack and command driver of FIG. 10 configured for NetBios communications.
FIG. 12 is a diagram of a communication exchange between the client of FIG. 6 and the server of FIG. 9.
FIG. 13 is a diagram of hardware functions included in the INIC of FIG. 9.
FIG. 14 is a diagram of a trio of pipelined microprocessors included in the INIC of FIG. 13, including three phases with a processor in each phase.
FIG. 15A is a diagram of a first phase of the pipelined microprocessor of FIG. 14.
FIG. 15B is a diagram of a second phase of the pipelined microprocessor of FIG. 14.
FIG. 15C is a diagram of a third phase of the pipelined microprocessor of FIG. 14.
FIG. 16 is a diagram of a plurality of queue storage units that interact with the microprocessor of FIG. 14 and include SRAM and DRAM.
FIG. 17 is a diagram of a set of status registers for the queues storage units of FIG. 16.
FIG. 18 is a diagram of a queue manager, which interacts, with the queue storage units and status registers of FIG. 16 and FIG. 17.
FIGS. 19A-D are diagrams of various stages of a least-recently-used register that is employed for allocating cache memory.
FIG. 20 is a diagram of the devices used to operate the least-recently-used register of FIGS. 19A-D.
FIG. 21 is another diagram of Intelligent Network Interface Card (INIC) 200 of FIG. 13.
FIG. 22 is a diagram of the receive sequencer of FIG. 21.
FIG. 23 is a diagram illustrating a “fast-path” transfer of data of a multi-packet message from INIC 200 to a destination 2311 in host 20.
DETAILED DESCRIPTION
FIG. 1 shows a host 20 of the present invention connected by a network 25 to a remote host 22. The increase in processing speed achieved by the present invention can be provided with an intelligent network interface card (INIC) that is easily and affordably added to an existing host, or with a communication processing device (CPD) that is integrated into a host, in either case freeing the host CPU from most protocol processing and allowing improvements in other tasks performed by that CPU. The host 20 in a first embodiment contains a CPU 28 and a CPD 30 connected by a host bus 33. The CPD 30 includes a microprocessor designed for processing communication data and memory buffers controlled by a direct memory access (DMA) unit. Also connected to the host bus 33 is a storage device 35, such as a semiconductor memory or disk drive, along with any related controls.
Referring additionally to FIG. 2, the host CPU 28 controls a protocol processing stack 44 housed in storage 35, the stack including a data link layer 36, network layer 38, transport layer 40, upper layer 46 and an upper layer interface 42. The upper layer 46 may represent a session, presentation and/or application layer, depending upon the particular protocol being employed and message communicated. The upper layer interface 42, along with the CPU 28 and any related controls can send or retrieve a file to or from the upper layer 46 or storage 35, as shown by arrow 48. A connection context 50 has been created, as will be explained below, the context summarizing various features of the connection, such as protocol type and source and destination addresses for each protocol layer. The context may be passed between an interface for the session layer 42 and the CPD 30, as shown by arrows 52 and 54, and stored as a communication control block (CCB) at either CPD 30 or storage 35.
When the CPD 30 holds a CCB defining a particular connection, data received by the CPD from the network and pertaining to the connection is referenced to that CCB and can then be sent directly to storage 35 according to a fast-path 58, bypassing sequential protocol processing by the data link 36, network 38 and transport 40 layers. Transmitting a message, such as sending a file from storage 35 to remote host 22, can also occur via the fast-path 58, in which case the context for the file data is added by the CPD 30 referencing a CCB, rather than by sequentially adding headers during processing by the transport 40, network 38 and data link 36 layers. The DMA controllers of the CPD 30 perform these transfers between CPD and storage 35.
The CPD 30 collapses multiple protocol stacks each having possible separate states into a single state machine for fast-path processing. As a result, exception conditions may occur that are not provided for in the single state machine, primarily because such conditions occur infrequently and to deal with them on the CPD would provide little or no performance benefit to the host. Such exceptions can be CPD 30 or CPU 28 initiated. An advantage of the invention includes the manner in which unexpected situations that occur on a fast-path CCB are handled. The CPD 30 deals with these rare situations by passing back or flushing to the host protocol stack 44 the CCB and any associated message frames involved, via a control negotiation. The exception condition is then processed in a conventional manner by the host protocol stack 44. At some later time, usually directly after the handling of the exception condition has completed and fast-path processing can resume, the host stack 44 hands the CCB back to the CPD.
This fallback capability enables the performance-impacting functions of the host protocols to be handled by the CPD network microprocessor, while the exceptions are dealt with by the host stacks, the exceptions being so rare as to negligibly effect overall performance. The custom designed network microprocessor can have independent processors for transmitting and receiving network information, and further processors for assisting and queuing. A preferred microprocessor embodiment includes a pipelined trio of receive, transmit and utility processors. DMA controllers are integrated into the implementation and work in close concert with the network microprocessor to quickly move data between buffers adjacent to the controllers and other locations such as long term storage. Providing buffers logically adjacent to the DMA controllers avoids unnecessary loads on the PCI bus.
FIG. 3 diagrams the general flow of messages received according to the current invention. A large TCP/IP message such as a file transfer may be received by the host from the network in a number of separate, approximately 64 KB transfers, each of which may be split into many, approximately 1.5 KB frames or packets for transmission over a network. Novell NetWare protocol suites running Sequenced Packet Exchange Protocol (SPX) or NetWare Core Protocol (NCP) over Internetwork Packet Exchange (IPX) work in a similar fashion. Another form of data communication which can be handled by the fast-path is Transaction TCP (hereinafter T/TCP or TTCP), a version of TCP which initiates a connection with an initial transaction request after which a reply containing data may be sent according to the connection, rather than initiating a connection via a several-message initialization dialogue and then transferring data with later messages. In any of the transfers typified by these protocols, each packet conventionally includes a portion of the data being transferred, as well as headers for each of the protocol layers and markers for positioning the packet relative to the rest of the packets of this message.
When a message packet or frame is received 47 from a network by the CPD, it is first validated by a hardware assist. This includes determining the protocol types of the various layers, verifying relevant checksums, and summarizing 57 these findings into a status word or words. Included in these words is an indication whether or not the frame is a candidate for fast-path data flow. Selection 59 of fast-path candidates is based on whether the host may benefit from this message connection being handled by the CPD, which includes determining whether the packet has header bytes indicating particular protocols, such as TCP/IP or SPX/IPX for example. The small percent of frames that are not fast-path candidates are sent 61 to the host protocol stacks for slow-path protocol processing. Subsequent network microprocessor work with each fast-path candidate determines whether a fast-path connection such as a TCP or SPX CCB is already extant for that candidate, or whether that candidate may be used to set up a new fast-path connection, such as for a TTCP/IP transaction. The validation provided by the CPD provides acceleration whether a frame is processed by the fast-path or a slow-path, as only error free, validated frames are processed by the host CPU even for the slow-path processing.
All received message frames which have been determined by the CPD hardware assist to be fast-path candidates are examined 53 by the network microprocessor or INIC comparator circuits to determine whether they match a CCB held by the CPD. Upon confirming such a match, the CPD removes lower layer headers and sends 69 the remaining application data from the frame directly into its final destination in the host using direct memory access (DMA) units of the CPD. This operation may occur immediately upon receipt of a message packet, for example when a TCP connection already exists and destination buffers have been negotiated, or it may first be necessary to process an initial header to acquire a new set of final destination addresses for this transfer. In this latter case, the CPD will queue subsequent message packets while waiting for the destination address, and then DMA the queued application data to that destination.
A fast-path candidate that does not match a CCB may be used to set up a new fast-path connection, by sending 65 the frame to the host for sequential protocol processing. In this case, the host uses this frame to create 51 a CCB, which is then passed to the CPD to control subsequent frames on that connection. The CCB, which is cached 67 in the CPD, includes control and state information pertinent to all protocols that would have been processed had conventional software layer processing been employed. The CCB also contains storage space for per-transfer information used to facilitate moving application-level data contained within subsequent related message packets directly to a host application in a form available for immediate usage. The CPD takes command of connection processing upon receiving a CCB for that connection from the host.
As shown more specifically in FIG. 4A, when a message packet is received from the remote host 22 via network 25, the packet enters hardware receive logic 32 of the CPD 30, which checksums headers and data, and parses the headers, creating a word or words which identify the message packet and status, storing the headers, data and word temporarily in memory 60. As well as validating the packet, the receive logic 32 indicates with the word whether this packet is a candidate for fast-path processing. FIG. 4A depicts the case in which the packet is not a fast-path candidate, in which case the CPD 30 sends the validated headers and data from memory 60 to data link layer 36 along an internal bus for processing by the host CPU, as shown by arrow 56. The packet is processed by the host protocol stack 44 of data link 36, network 38, transport 40 and session 42 layers, and data (D) 63 from the packet may then be sent to storage 35, as shown by arrow 65.
FIG. 4B, depicts the case in which the receive logic 32 of the CPD determines that a message packet is a candidate for fast-path processing, for example by deriving from the packet's headers that the packet belongs to a TCP/IP, TTCP/IP or SPX/IPX message. A processor 55 in the CPD 30 then checks to see whether the word that summarizes the fast-path candidate matches a CCB held in a cache 62. Upon finding no match for this packet, the CPD sends the validated packet from memory 60 to the host protocol stack 44 for processing. Host stack 44 may use this packet to create a connection context for the message, including finding and reserving a destination for data from the message associated with the packet, the context taking the form of a CCB. The present embodiment employs a single specialized host stack 44 for processing both fast-path and non-fast-path candidates, while in an embodiment described below fast-path candidates are processed by a different host stack than non-fast-path candidates. Some data (D1) 66 from that initial packet may optionally be sent to the destination in storage 35, as shown by arrow 68. The CCB is then sent to the CPD 30 to be saved in cache 62, as shown by arrow 64. For a traditional connection-based message such as typified by TCP/IP, the initial packet may be part of a connection initialization dialogue that transpires between hosts before the CCB is created and passed to the CPD 30.
Referring now to FIG. 4C, when a subsequent packet from the same connection as the initial packet is received from the network 25 by CPD 30, the packet headers and data are validated by the receive logic 32, and the headers are parsed to create a summary of the message packet and a hash for finding a corresponding CCB, the summary and hash contained in a word or words. The word or words are temporarily stored in memory 60 along with the packet. The processor 55 checks for a match between the hash and each CCB that is stored in the cache 62 and, finding a match, sends the data (D2) 70 via a fast-path directly to the destination in storage 35, as shown by arrow 72, bypassing the session layer 42, transport layer 40, network layer 38 and data link layer 36. The remaining data packets from the message can also be sent by DMA directly to storage, avoiding the relatively slow protocol layer processing and repeated copying by the CPU stack 44.
FIG. 4D shows the procedure for handling the rare instance when a message for which a fast-path connection has been established, such as shown in FIG. 4C, has a packet that is not easily handled by the CPD. In this case the packet is sent to be processed by the protocol stack 44, which is handed the CCB for that message from cache 62 via a control dialogue with the CPD, as shown by arrow 76, signaling to the CPU to take over processing of that message. Slow-path processing by the protocol stack then results in data (D3) 80 from the packet being sent, as shown by arrow 82, to storage 35. Once the packet has been processed and the error situation corrected, the CCB can be handed back via a control dialogue to the cache 62, so that payload data from subsequent packets of that message can again be sent via the fast-path of the CPD 30. Thus the CPU and CPD together decide whether a given message is to be processed according to fast-path hardware processing or more conventional software processing by the CPU.
Transmission of a message from the host 20 to the network 25 for delivery to remote host 22 also can be processed by either sequential protocol software processing via the CPU or accelerated hardware processing via the CPD 30, as shown in FIG. 5. A message (M) 90 that is selected by CPU 28 from storage 35 can be sent to session layer 42 for processing by stack 44, as shown by arrows 92 and 96. For the situation in which a connection exists and the CPD 30 already has an appropriate CCB for the message, however, data packets can bypass host stack 44 and be sent by DMA directly to memory 60, with the processor 55 adding to each data packet a single header containing all the appropriate protocol layers, and sending the resulting packets to the network 25 for transmission to remote host 22. This fast-path transmission can greatly accelerate processing for even a single packet, with the acceleration multiplied for a larger message.
A message for which a fast-path connection is not extant thus may benefit from creation of a CCB with appropriate control and state information for guiding fast-path transmission. For a traditional connection-based message, such as typified by TCP/IP or SPX/IPX, the CCB is created during connection initialization dialogue. For a quick-connection message, such as typified by TTCP/IP, the CCB can be created with the same transaction that transmits payload data. In this case, the transmission of payload data may be a reply to a request that was used to set up the fast-path connection. In any case, the CCB provides protocol and status information regarding each of the protocol layers, including which user is involved and storage space for per-transfer information. The CCB is created by protocol stack 44, which then passes the CCB to the CPD 30 by writing to a command register of the CPD, as shown by arrow 98. Guided by the CCB, the processor 55 moves network frame-sized portions of the data from the source in host memory 35 into its own memory 60 using DMA, as depicted by arrow 99. The processor 55 then prepends appropriate headers and checksums to the data portions, and transmits the resulting frames to the network 25, consistent with the restrictions of the associated protocols. After the CPD 30 has received an acknowledgement that all the data has reached its destination, the CPD will then notify the host 35 by writing to a response buffer. Thus, fast-path transmission of data communications also relieves the host CPU of per-frame processing. A vast majority of data transmissions can be sent to the network by the fast-path. Both the input and output fast-paths attain a huge reduction in interrupts by functioning at an upper layer level, i.e., session level or higher, and interactions between the network microprocessor and the host occur using the full transfer sizes which that upper layer wishes to make. For fast-path communications, an interrupt only occurs (at the most) at the beginning and end of an entire upper-layer message transaction, and there are no interrupts for the sending or receiving of each lower layer portion or packet of that transaction.
A simplified intelligent network interface card (INIC) 150 is shown in FIG. 6 to provide a network interface for a host 152. Hardware logic 171 of the INIC 150 is connected to a network 155, with a peripheral bus (PCI) 157 connecting the INIC and host. The host 152 in this embodiment has a TCP/IP protocol stack, which provides a slow-path 158 for sequential software processing of message frames received from the network 155. The host 152 protocol stack includes a data link layer 160, network layer 162, a transport layer 164 and an application layer 166, which provides a source or destination 168 for the communication data in the host 152. Other layers which are not shown, such as session and presentation layers, may also be included in the host stack 152, and the source or destination may vary depending upon the nature of the data and may actually be the application layer.
The INIC 150 has a network processor 170 which chooses between processing messages along a slow-path 158 that includes the protocol stack of the host, or along a fast-path 159 that bypasses the protocol stack of the host. Each received packet is processed on the fly by hardware logic 171 contained in INIC 150, so that all of the protocol headers for a packet can be processed without copying, moving or storing the data between protocol layers. The hardware logic 171 processes the headers of a given packet at one time as packet bytes pass through the hardware, by categorizing selected header bytes. Results of processing the selected bytes help to determine which other bytes of the packet are categorized, until a summary of the packet has been created, including checksum validations. The processed headers and data from the received packet are then stored in INIC storage 185, as well as the word or words summarizing the headers and status of the packet. For a network storage configuration, the INIC 150 may be connected to a peripheral storage device such as a disk drive which has an IDE, SCSI or similar interface, with a file cache for the storage device residing on the memory 185 of the INIC 150. Several such network interfaces may exist for a host, with each interface having an associated storage device.
The hardware processing of message packets received by INIC 150 from network 155 is shown in more detail in FIG. 7. A received message packet first enters a media access controller 172, which controls INIC access to the network and receipt of packets and can provide statistical information for network protocol management. From there, data flows one byte at a time into an assembly register 174, which in this example is 128 bits wide. The data is categorized by a fly-by sequencer 178, as will be explained in more detail with regard to FIG. 8, which examines the bytes of a packet as they fly by, and generates status from those bytes that will be used to summarize the packet. The status thus created is merged with the data by a multiplexor 180 and the resulting data stored in SRAM 182. A packet control sequencer 176 oversees the fly-by sequencer 178, examines information from the media access controller 172, counts the bytes of data, generates addresses, moves status and manages the movement of data from the assembly register 174 to SRAM 182 and eventually DRAM 188. The packet control sequencer 176 manages a buffer in SRAM 182 via SRAM controller 183, and also indicates to a DRAM controller 186 when data needs to be moved from SRAM 182 to a buffer in DRAM 188. Once data movement for the packet has been completed and all the data has been moved to the buffer in DRAM 188, the packet control sequencer 176 will move the status that has been generated in the fly-by sequencer 178 out to the SRAM 182 and to the beginning of the DRAM 188 buffer to be prepended to the packet data. The packet control sequencer 176 then requests a queue manager 184 to enter a receive buffer descriptor into a receive queue, which in turn notifies the processor 170 that the packet has been processed by hardware logic 171 and its status summarized.
FIG. 8 shows that the fly-by sequencer 178 has several tiers, with each tier generally focusing on a particular portion of the packet header and thus on a particular protocol layer, for generating status pertaining to that layer. The fly-by sequencer 178 in this embodiment includes a media access control sequencer 191, a network sequencer 192, a transport sequencer 194 and a session sequencer 195. Sequencers pertaining to higher protocol layers can additionally be provided. The fly-by sequencer 178 is reset by the packet control sequencer 176 and given pointers by the packet control sequencer that tell the fly-by sequencer whether a given byte is available from the assembly register 174. The media access control sequencer 191 determines, by looking at bytes 0-5, that a packet is addressed to host 152 rather than or in addition to another host. Offsets 12 and 13 of the packet are also processed by the media access control sequencer 191 to determine the type field, for example whether the packet is Ethernet or 802.3. If the type field is Ethernet those bytes also tell the media access control sequencer 191 the packet's network protocol type. For the 802.3 case, those bytes instead indicate the length of the entire frame, and the media access control sequencer 191 will check eight bytes further into the packet to determine the network layer type.
For most packets the network sequencer 192 validates that the header length received has the correct length, and checksums the network layer header. For fast-path candidates the network layer header is known to be IP or IPX from analysis done by the media access control sequencer 191. Assuming for example that the type field is 802.3 and the network protocol is IP, the network sequencer 192 analyzes the first bytes of the network layer header, which will begin at byte 22, in order to determine IP type. The first bytes of the IP header will be processed by the network sequencer 192 to determine what IP type the packet involves. Determining that the packet involves, for example, IP version 4, directs further processing by the network sequencer 192, which also looks at the protocol type located ten bytes into the IP header for an indication of the transport header protocol of the packet. For example, for IP over Ethernet, the IP header begins at offset 14, and the protocol type byte is offset 23, which will be processed by network logic to determine whether the transport layer protocol is TCP, for example. From the length of the network layer header, which is typically 20-40 bytes, network sequencer 192 determines the beginning of the packet's transport layer header for validating the transport layer header. Transport sequencer 194 may generate checksums for the transport layer header and data, which may include information from the IP header in the case of TCP at least.
Continuing with the example of a TCP packet, transport sequencer 194 also analyzes the first few bytes in the transport layer portion of the header to determine, in part, the TCP source and destination ports for the message, such as whether the packet is NetBios or other protocols. Byte 12 of the TCP header is processed by the transport sequencer 194 to determine and validate the TCP header length. Byte 13 of the TCP header contains flags that may, aside from ack flags and push flags, indicate unexpected options, such as reset and fin, that may cause the processor to categorize this packet as an exception. TCP offset bytes 16 and 17 are the checksum, which is pulled out and stored by the hardware logic 171 while the rest of the frame is validated against the checksum.
Session sequencer 195 determines the length of the session layer header, which in the case of NetBios is only four bytes, two of which tell the length of the NetBios payload data, but which can be much larger for other protocols. The session sequencer 195 can also be used to categorize the type of message as read or write, for example, for which the fast-path may be particularly beneficial. Further upper layer logic processing, depending upon the message type, can be performed by the hardware logic 171 of packet control sequencer 176 and fly-by sequencer 178. Thus hardware logic 171 intelligently directs hardware processing of the headers by categorization of selected bytes from a single stream of bytes, with the status of the packet being built from classifications determined on the fly. Once the packet control sequencer 176 detects that all of the packet has been processed by the fly-by sequencer 178, the packet control sequencer 176 adds the status information generated by the fly-by sequencer 178 and any status information generated by the packet control sequencer 176, and prepends (adds to the front) that status information to the packet, for convenience in handling the packet by the processor 170. The additional status information generated by the packet control sequencer 176 includes media access controller 172 status information and any errors discovered, or data overflow in either the assembly register or DRAM buffer, or other miscellaneous information regarding the packet. The packet control sequencer 176 also stores entries into a receive buffer queue and a receive statistics queue via the queue manager 184. An advantage of processing a packet by hardware logic 171 is that the packet does not, in contrast with conventional sequential software protocol processing, have to be stored, moved, copied or pulled from storage for processing each protocol layer header, offering dramatic increases in processing efficiency and savings in processing time for each packet. The packets can be processed at the rate bits are received from the network, for example 100 megabits/second for a 100 baseT connection. The time for categorizing a packet received at this rate and having a length of sixty bytes is thus about 5 microseconds. The total time for processing this packet with the hardware logic 171 and sending packet data to its host destination via the fast-path may be about 16 microseconds or less, assuming a 66 MHz PCI bus, whereas conventional software protocol processing by a 300 MHz Pentium II® processor may take as much as 200 microseconds in a busy device. More than an order of magnitude decrease in processing time can thus be achieved with fast-path 159 in comparison with a high-speed CPU employing conventional sequential software protocol processing, demonstrating the dramatic acceleration provided by processing the protocol headers by the hardware logic 171 and processor 170, without even considering the additional time savings afforded by the reduction in CPU interrupts and host bus bandwidth savings.
The processor 170 chooses, for each received message packet held in storage 185, whether that packet is a candidate for the fast-path 159 and, if so, checks to see whether a fast-path has already been set up for the connection that the packet belongs to. To do this, the processor 170 first checks the header status summary to determine whether the packet headers are of a protocol defined for fast-path candidates. If not, the processor 170 commands DMA controllers in the INIC 150 to send the packet to the host for slow-path 158 processing. Even for a slow-path 158 processing of a message, the INIC 150 thus performs initial procedures such as validation and determination of message type, and passes the validated message at least to the data link layer 160 of the host.
For fast-path 159 candidates, the processor 170 checks to see whether the header status summary matches a CCB held by the INIC. If so, the data from the packet is sent along fast-path 159 to the destination 168 in the host. If the fast-path 159 candidate's packet summary does not match a CCB held by the INIC, the packet may be sent to the host 152 for slow-path processing to create a CCB for the message. Employment of the fast-path 159 may also not be needed or desirable for the case of fragmented messages or other complexities. For the vast majority of messages, however, the INIC fast-path 159 can greatly accelerate message processing. The INIC 150 thus provides a single state machine processor 170 that decides whether to send data directly to its destination, based upon information gleaned on the fly, as opposed to the conventional employment of a state machine in each of several protocol layers for determining the destiny of a given packet.
In processing an indication or packet received at the host 152, a protocol driver of the host selects the processing route based upon whether the indication is fast-path or slow-path. A TCP/IP or SPX/IPX message has a connection that is set up from which a CCB is formed by the driver and passed to the INIC for matching with and guiding the fast-path packet to the connection destination 168. For a TTCP/IP message, the driver can create a connection context for the transaction from processing an initial request packet, including locating the message destination 168, and then passing that context to the INIC in the form of a CCB for providing a fast-path for a reply from that destination. A CCB includes connection and state information regarding the protocol layers and packets of the message. Thus a CCB can include source and destination media access control (MAC) addresses, source and destination IP or IPX addresses, source and destination TCP or SPX ports, TCP variables such as timers, receive and transmit windows for sliding window protocols, and information indicating the session layer protocol.
Caching the CCBs in a hash table in the INIC provides quick comparisons with words summarizing incoming packets to determine whether the packets can be processed via the fast-path 159, while the full CCBs are also held in the INIC for processing. Other ways to accelerate this comparison include software processes such as a B-tree or hardware assists such as a content addressable memory (CAM). When INIC microcode or comparator circuits detect a match with the CCB, a DMA controller places the data from the packet in the destination 168, without any interrupt by the CPU, protocol processing or copying. Depending upon the type of message received, the destination of the data may be the session, presentation or application layers, or a file buffer cache in the host 152.
FIG. 9 shows an INIC 200 connected to a host 202 that is employed as a file server. This INIC provides a network interface for several network connections employing the 802.3 u standard, commonly known as Fast Ethernet. The INIC 200 is connected by a PCI bus 205 to the server 202, which maintains a TCP/IP or SPX/IPX protocol stack including MAC layer 212, network layer 215, transport layer 217 and application layer 220, with a source/destination 222 shown above the application layer, although as mentioned earlier the application layer can be the source or destination. The INIC is also connected to network lines 210, 240, 242 and 244, which are preferably Fast Ethernet, twisted pair, fiber optic, coaxial cable or other lines each allowing data transmission of 100 Mb/s, while faster and slower data rates are also possible. Network lines 210, 240, 242 and 244 are each connected to a dedicated row of hardware circuits which can each validate and summarize message packets received from their respective network line. Thus line 210 is connected with a first horizontal row of sequencers 250, line 240 is connected with a second horizontal row of sequencers 260, line 242 is connected with a third horizontal row of sequencers 262 and line 244 is connected with a fourth horizontal row of sequencers 264. After a packet has been validated and summarized by one of the horizontal hardware rows it is stored along with its status summary in storage 270.
A network processor 230 determines, based on that summary and a comparison with any CCBs stored in the INIC 200, whether to send a packet along a slow-path 231 for processing by the host. A large majority of packets can avoid such sequential processing and have their data portions sent by DMA along a fast-path 237 directly to the data destination 222 in the server according to a matching CCB. Similarly, the fast-path 237 provides an avenue to send data directly from the source 222 to any of the network lines by processor 230 division of the data into packets and addition of full headers for network transmission, again minimizing CPU processing and interrupts. For clarity only horizontal sequencer 250 is shown active; in actuality each of the sequencer rows 250, 260, 262 and 264 offers full duplex communication, concurrently with all other sequencer rows. The specialized INIC 200 is much faster at working with message packets than even advanced general-purpose host CPUs that processes those headers sequentially according to the software protocol stack.
One of the most commonly used network protocols for large messages such as file transfers is server message block (SMB) over TCP/IP. SMB can operate in conjunction with redirector software that determines whether a required resource for a particular operation, such as a printer or a disk upon which a file is to be written, resides in or is associated with the host from which the operation was generated or is located at another host connected to the network, such as a file server. SMB and server/redirector are conventionally serviced by the transport layer; in the present invention SMB and redirector can instead be serviced by the INIC. In this case, sending data by the DMA controllers from the INIC buffers when receiving a large SMB transaction may greatly reduce interrupts that the host must handle. Moreover, this DMA generally moves the data to its final destination in the file device cache. An SMB transmission of the present invention follows essentially the reverse of the above described SMB receive, with data transferred from the host to the INIC and stored in buffers, while the associated protocol headers are prepended to the data in the INIC, for transmission via a network line to a remote host. Processing by the INIC of the multiple packets and multiple TCP, IP, NetBios and SMB protocol layers via custom hardware and without repeated interrupts of the host can greatly increase the speed of transmitting an SMB message to a network line.
As shown in FIG. 10, for controlling whether a given message is processed by the host 202 or by the INIC 200, a message command driver 300 may be installed in host 202 to work in concert with a host protocol stack 310. The command driver 300 can intervene in message reception or transmittal, create CCBs and send or receive CCBs from the INIC 200, so that functioning of the INIC, aside from improved performance, is transparent to a user. Also shown is an INIC memory 304 and an INIC miniport driver 306, which can direct message packets received from network 210 to either the conventional protocol stack 310 or the command protocol stack 300, depending upon whether a packet has been labeled as a fast-path candidate. The conventional protocol stack 310 has a data link layer 312, a network layer 314 and a transport layer 316 for conventional, lower layer processing of messages that are not labeled as fast-path candidates and therefore not processed by the command stack 300. Residing above the lower layer stack 310 is an upper layer 318, which represents a session, presentation and/or application layer, depending upon the message communicated. The command driver 300 similarly has a data link layer 320, a network layer 322 and a transport layer 325.
The driver 300 includes an upper layer interface 330 that determines, for transmission of messages to the network 210, whether a message transmitted from the upper layer 318 is to be processed by the command stack 300 and subsequently the INIC fast-path, or by the conventional stack 310. When the upper layer interface 330 receives an appropriate message from the upper layer 318 that would conventionally be intended for transmission to the network after protocol processing by the protocol stack of the host, the message is passed to driver 300. The INIC then acquires network-sized portions of the message data for that transmission via INIC DMA units, prepends headers to the data portions and sends the resulting message packets down the wire. Conversely, in receiving a TCP, TTCP, SPX or similar message packet from the network 210 to be used in setting up a fast-path connection, miniport driver 306 diverts that message packet to command driver 300 for processing. The driver 300 processes the message packet to create a context for that message, with the driver 302 passing the context and command instructions back to the INIC 200 as a CCB for sending data of subsequent messages for the same connection along a fast-path. Hundreds of TCP, TTCP, SPX or similar CCB connections may be held indefinitely by the INIC, although a least recently used (LRU) algorithm is employed for the case when the INIC cache is full. The driver 300 can also create a connection context for a TTCP request which is passed to the INIC 200 as a CCB, allowing fast-path transmission of a TTCP reply to the request. A message having a protocol that is not accelerated can be processed conventionally by protocol stack 310.
FIG. 11 shows a TCP/IP implementation of command driver software for Microsoft® protocol messages. A conventional host protocol stack 350 includes MAC layer 353, IP layer 355 and TCP layer 358. A command driver 360 works in concert with the host stack 350 to process network messages. The command driver 360 includes a MAC layer 363, an IP layer 366 and an Alacritech TCP (ATCP) layer 373. The conventional stack 350 and command driver 360 share a network driver interface specification (NDIS) layer 375, which interacts with the INIC miniport driver 306. The INIC miniport driver 306 sorts receive indications for processing by either the conventional host stack 350 or the ATCP driver 360. A TDI filter driver and upper layer interface 380 similarly determines whether messages sent from a TDI user 382 to the network are diverted to the command driver and perhaps to the fast-path of the INIC, or processed by the host stack.
FIG. 12 depicts a typical SMB exchange between a client 190 and server 290, both of which have communication devices of the present invention, the communication devices each holding a CCB defining their connection for fast-path movement of data. The client 190 includes INIC 150, 802.3 compliant data link layer 160, IP layer 162, TCP layer 164, NetBios layer 166, and SMB layer 168. The client has a slow-path 157 and fast-path 159 for communication processing. Similarly, the server 290 includes INIC 200, 802.3 compliant data link layer 212, IP layer 215, TCP layer 217, NetBios layer 220, and SMB 222. The server is connected to network lines 240, 242 and 244, as well as line 210 which is connected to client 190. The server also has a slow-path 231 and fast-path 237 for communication processing. Assuming that the client 190 wishes to read a 100 KB file on the server 290, the client may begin by sending a Read Block Raw (RBR) SMB command across network 210 requesting the first 64 KB of that file on the server 290. The RBR command may be only 76 bytes, for example, so the INIC 200 on the server will recognize the message type (SMB) and relatively small message size, and send the 76 bytes directly via the fast-path to NetBios of the server. NetBios will give the data to SMB, which processes the Read request and fetches the 64 KB of data into server data buffers. SMB then calls NetBios to send the data, and NetBios outputs the data for the client. In a conventional host, NetBios would call TCP output and pass 64 KB to TCP, which would divide the data into 1460 byte segments and output each segment via IP and eventually MAC (slow-path 231). In the present case, the 64 KB data goes to the ATCP driver along with an indication regarding the client-server SMB connection, which indicates a CCB held by the INIC. The INIC 200 then proceeds to DMA 1460 byte segments from the host buffers, add the appropriate headers for TCP, IP and MAC at one time, and send the completed packets on the network 210 (fast-path 237). The INIC 200 will repeat this until the whole 64 KB transfer has been sent. Usually after receiving acknowledgement from the client that the 64 KB has been received, the INIC will then send the remaining 36 KB also by the fast-path 237.
With INIC 150 operating on the client 190 when this reply arrives, the INIC 150 recognizes from the first frame received that this connection is receiving fast-path 159 processing (TCP/IP, NetBios, matching a CCB), and the ATCP may use this first frame to acquire buffer space for the message. This latter case is done by passing the first 128 bytes of the NetBios portion of the frame via the ATCP fast-path directly to the host NetBios; that will give NetBios/SMB all of the frame's headers. NetBios/SMB will analyze these headers, realize by matching with a request ID that this is a reply to the original RawRead connection, and give the ATCP a 64 K list of buffers into which to place the data. At this stage only one frame has arrived, although more may arrive while this processing is occurring. As soon as the client buffer list is given to the ATCP, it passes that transfer information to the INIC 150, and the INIC 150 starts DMAing any frame data that has accumulated into those buffers.
FIG. 13 provides a simplified diagram of the INIC 200, which combines the functions of a network interface controller and a protocol processor in a single ASIC chip 400. The INIC 200 in this embodiment offers a full-duplex, four channel, 10/100-Megabit per second (Mbps) intelligent network interface controller that is designed for high speed protocol processing for server applications. Although designed specifically for server applications, the INIC 200 can be connected to personal computers, workstations, routers or other hosts anywhere that TCP/IP, TTCP/IP or SPX/IPX protocols are being utilized.
The INIC 200 is connected with four network lines 210, 240, 242 and 244, which may transport data along a number of different conduits, such as twisted pair, coaxial cable or optical fiber, each of the connections providing a media independent interface (MII) via commercially available physical layer chips, such as model 80220/80221 Ethernet Media Interface Adapter from SEEQ Technology Incorporated, 47200 Bayside Parkway, Fremont, Calif. 94538. The lines preferably are 802.3 compliant and in connection with the INIC constitute four complete Ethernet nodes, the INIC supporting 10Base-T, 10Base-T2, 100Base-TX, 100Base-FX and 100Base-T4 as well as future interface standards. Physical layer identification and initialization is accomplished through host driver initialization routines. The connection between the network lines 210, 240, 242 and 244 and the INIC 200 is controlled by MAC units MAC-A 402, MAC-B 404, MAC-C 406 and MAC-D 408 which contain logic circuits for performing the basic functions of the MAC sublayer, essentially controlling when the INIC accesses the network lines 210, 240, 242 and 244. The MAC units 402-408 may act in promiscuous, multicast or unicast modes, allowing the INIC to function as a network monitor, receive broadcast and multicast packets and implement multiple MAC addresses for each node. The MAC units 402-408 also provide statistical information that can be used for simple network management protocol (SNMP).
The MAC units 402, 404, 406 and 408 are each connected to a transmit and receive sequencer, XMT & RCV-A 418, XMT & RCV-B 420, XMT & RCV-C 422 and XMT & RCV-D 424, by wires 410, 412, 414 and 416, respectively. Each of the transmit and receive sequencers can perform several protocol processing steps on the fly as message frames pass through that sequencer. In combination with the MAC units, the transmit and receive sequencers 418-422 can compile the packet status for the data link, network, transport, session and, if appropriate, presentation and application layer protocols in hardware, greatly reducing the time for such protocol processing compared to conventional sequential software engines. The transmit and receive sequencers 410-414 are connected, by lines 426, 428, 430 and 432 to an SRAM and DMA controller 444, which includes DMA controllers 438 and SRAM controller 442. Static random access memory (SRAM) buffers 440 are coupled with SRAM controller 442 by line 441. The SRAM and DMA controllers 444 interact across line 446 with external memory control 450 to send and receive frames via external memory bus 455 to and from dynamic random access memory (DRAM) buffers 460, which is located adjacent to the IC chip 400. The DRAM buffers 460 may be configured as 4 MB, 8 MB, 16 MB or 32 MB, and may optionally be disposed on the chip. The SRAM and DMA controllers 444 are connected via line 464 to a PCI Bus Interface Unit (BIU) 468, which manages the interface between the INIC 200 and the PCI interface bus 257. The 64-bit, multiplexed BIU 468 provides a direct interface to the PCI bus 257 for both slave and master functions. The INIC 200 is capable of operating in either a 64-bit or 32-bit PCI environment, while supporting 64-bit addressing in either configuration.
A microprocessor 470 is connected by line 472 to the SRAM and DMA controllers 444, and connected via line 475 to the PCI BIU 468. Microprocessor 470 instructions and register files reside in an on chip control store 480, which includes a writable on-chip control store (WCS) of SRAM and a read only memory (ROM), and is connected to the microprocessor by line 477. The microprocessor 470 offers a programmable state machine which is capable of processing incoming frames, processing host commands, directing network traffic and directing PCI bus traffic. Three processors are implemented using shared hardware in a three level pipelined architecture that launches and completes a single instruction for every clock cycle. A receive processor 482 is primarily used for receiving communications while a transmit processor 484 is primarily used for transmitting communications in order to facilitate full duplex communication, while a utility processor 486 offers various functions including overseeing and controlling PCI register access.
The instructions for the three processors 482, 484 and 486 reside in the on-chip control-store 480. Thus the functions of the three processors can be easily redefined, so that the microprocessor 470 can adapted for a given environment. For instance, the amount of processing required for receive functions may outweigh that required for either transmit or utility functions. In this situation, some receive functions may be performed by the transmit processor 484 and/or the utility processor 486. Alternatively, an additional level of pipelining can be created to yield four or more virtual processors instead of three, with the additional level devoted to receive functions.
The INIC 200 in this embodiment can support up to 256 CCBs which are maintained in a table in the DRAM 460. There is also, however, a CCB index in hash order in the SRAM 440 to save sequential searching. Once a hash has been generated, the CCB is cached in SRAM, with up to sixteen cached CCBs in SRAM in this example. Allocation of the sixteen CCBs cached in SRAM is handled by a least recently used register, described below. These cache locations are shared between the transmit 484 and receive 486 processors so that the processor with the heavier load is able to use more cache buffers. There are also eight header buffers and eight command buffers to be shared between the sequencers. A given header or command buffer is not statically linked to a specific CCB buffer, as the link is dynamic on a per-frame basis.
FIG. 14 shows an overview of the pipelined microprocessor 470, in which instructions for the receive, transmit and utility processors are executed in three alternating phases according to Clock increments I, II and III, the phases corresponding to each of the pipeline stages. Each phase is responsible for different functions, and each of the three processors occupies a different phase during each Clock increment. Each processor usually operates upon a different instruction stream from the control store 480, and each carries its own program counter and status through each of the phases.
In general, a first instruction phase 500 of the pipelined microprocessors completes an instruction and stores the result in a destination operand, fetches the next instruction, and stores that next instruction in an instruction register. A first register set 490 provides a number of registers including the instruction register, and a set of controls 492 for first register set provides the controls for storage to the first register set 490. Some items pass through the first phase without modification by the controls 492, and instead are simply copied into the first register set 490 or a RAM file register 533. A second instruction phase 560 has an instruction decoder and operand multiplexer 498 that generally decodes the instruction that was stored in the instruction register of the first register set 490 and gathers any operands which have been generated, which are then stored in a decode register of a second register set 496. The first register set 490, second register set 496 and a third register set 501, which is employed in a third instruction phase 600, include many of the same registers, as will be seen in the more detailed views of FIGS. 15A-C. The instruction decoder and operand multiplexer 498 can read from two address and data ports of the RAM file register 533, which operates in both the first phase 500 and second phase 560. A third phase 600 of the processor 470 has an arithmetic logic unit (ALU) 602 which generally performs any ALU operations on the operands from the second register set, storing the results in a results register included in the third register set 501. A stack exchange 608 can reorder register stacks, and a queue manager 503 can arrange queues for the processor 470, the results of which are stored in the third register set. The instructions continue with the first phase then following the third phase, as depicted by a circular pipeline 505. Note that various functions have been distributed across the three phases of the instruction execution in order to minimize the combinatorial delays within any given phase. With a frequency in this embodiment of 66 MHz, each Clock increment takes 15 nanoseconds to complete, for a total of 45 nanoseconds to complete one instruction for each of the three processors. The rotating instruction phases are depicted in more detail in FIGS. 15A-C, in which each phase is shown in a different figure.
More particularly, FIG. 15A shows some specific hardware functions of the first phase 500, which generally includes the first register set 490 and related controls 492. The controls for the first register set 492 includes an SRAM control 502, which is a logical control for loading address and write data into SRAM address and data registers 520. Thus the output of the ALU 602 from the third phase 600 may be placed by SRAM control 502 into an address register or data register of SRAM address and data registers 520. A load control 504 similarly provides controls for writing a context for a file to file context register 522, and another load control 506 provides controls for storing a variety of miscellaneous data to flip-flop registers 525. ALU condition codes, such as whether a carried bit is set, get clocked into ALU condition codes register 528 without an operation performed in the first phase 500. Flag decodes 508 can perform various functions, such as setting locks, that get stored in flag registers 530.
The RAM file register 533 has a single write port for addresses and data and two read ports for addresses and data, so that more than one register can be read from at one time. As noted above, the RAM file register 533 essentially straddles the first and second phases, as it is written in the first phase 500 and read from in the second phase 560. A control store instruction 510 allows the reprogramming of the processors due to new data in from the control store 480, not shown in this figure, the instructions stored in an instruction register 535. The address for this is generated in a fetch control register 511, which determines which address to fetch, the address stored in fetch address register 538. Load control 515 provides instructions for a program counter 540, which operates much like the fetch address for the control store. A last-in first-out stack 544 of three registers is copied to the first register set without undergoing other operations in this phase. Finally, a load control 517 for a debug address 548 is optionally included, which allows correction of errors that may occur.
FIG. 15B depicts the second microprocessor phase 560, which includes reading addresses and data out of the RAM file register 533. A scratch SRAM 565 is written from SRAM address and data register 520 of the first register set, which includes a register that passes through the first two phases to be incremented in the third. The scratch SRAM 565 is read by the instruction decoder and operand multiplexer 498, as are most of the registers from the first register set, with the exception of the stack 544, debug address 548 and SRAM address and data register mentioned above. The instruction decoder and operand multiplexer 498 looks at the various registers of set 490 and SRAM 565, decodes the instructions and gathers the operands for operation in the next phase, in particular determining the operands to provide to the ALU 602 below. The outcome of the instruction decoder and operand multiplexer 498 is stored to a number of registers in the second register set 496, including ALU operands 579 and 582, ALU condition code register 580, and a queue channel and command 587 register, which in this embodiment can control thirty-two queues. Several of the registers in set 496 are loaded fairly directly from the instruction register 535 above without substantial decoding by the decoder 498, including a program control 590, a literal field 589, a test select 584 and a flag select 585. Other registers such as the file context 522 of the first phase 500 are always stored in a file context 577 of the second phase 560, but may also be treated as an operand that is gathered by the multiplexer 572. The stack registers 544 are simply copied in stack register 594. The program counter 540 is incremented 568 in this phase and stored in register 592. Also incremented 570 is the optional debug address 548, and a load control 575 may be fed from the pipeline 505 at this point in order to allow error control in each phase, the result stored in debug address 598.
FIG. 15C depicts the third microprocessor phase 600, which includes ALU and queue operations. The ALU 602 includes an adder, priority encoders and other standard logic functions. Results of the ALU are stored in registers ALU output 618, ALU condition codes 620 and destination operand results 622. A file context register 616, flag select register 626 and literal field register 630 are simply copied from the previous phase 560. A test multiplexer 604 is provided to determine whether a conditional jump results in a jump, with the results stored in a test results register 624. The test multiplexer 604 may instead be performed in the first phase 500 along with similar decisions such as fetch control 511. A stack exchange 608 shifts a stack up or down by fetching a program counter from stack 594 or putting a program counter onto that stack, results of which are stored in program control 634, program counter 638 and stack 640 registers. The SRAM address may optionally be incremented in this phase 600. Another load control 610 for another debug address 642 may be forced from the pipeline 505 at this point in order to allow error control in this phase also. A QRAM & QALU 606, shown together in this figure, read from the queue channel and command register 587, store in SRAM and rearrange queues, adding or removing data and pointers as needed to manage the queues of data, sending results to the test multiplexer 604 and a queue flags and queue address register 628. Thus the QRAM & QALU 606 assume the duties of managing queues for the three processors, a task conventionally performed sequentially by software on a CPU, the queue manager 606 instead providing accelerated and substantially parallel hardware queuing.
FIG. 16 depicts two of the thirty-two hardware queues that are managed by the queue manager 606, with each of the queues having an SRAM head, an SRAM tail and the ability to queue information in a DRAM body as well, allowing expansion and individual configuration of each queue. Thus FIFO 700 has SRAM storage units, 705, 707, 709 and 711, each containing eight bytes for a total of thirty-two bytes, although the number and capacity of these units may vary in other embodiments. Similarly, FIFO 702 has SRAM storage units 713, 715, 717 and 719. SRAM units 705 and 707 are the head of FIFO 700 and units 709 and 711 are the tail of that FIFO, while units 713 and 715 are the head of FIFO 702 and units 717 and 719 are the tail of that FIFO. Information for FIFO 700 may be written into head units 705 or 707, as shown by arrow 722, and read from tail units 711 or 709, as shown by arrow 725. A particular entry, however, may be both written to and read from head units 705 or 707, or may be both written to and read from tail units 709 or 711, minimizing data movement and latency. Similarly, information for FIFO 702 is typically written into head units 713 or 715, as shown by arrow 733, and read from tail units 717 or 719, as shown by arrow 739, but may instead be read from the same head or tail unit to which it was written.
The SRAM FIFOS 700 and 702 are both connected to DRAM 460, which allows virtually unlimited expansion of those FIFOS to handle situations in which the SRAM head and tail are full. For example a first of the thirty-two queues, labeled Q-zero, may queue an entry in DRAM 460, as shown by arrow 727, by DMA units acting under direction of the queue manager, instead of being queued in the head or tail of FIFO 700. Entries stored in DRAM 460 return to SRAM unit 709, as shown by arrow 730, extending the length and fall-through time of that FIFO. Diversion from SRAM to DRAM is typically reserved for when the SRAM is full, since DRAM is slower and DMA movement causes additional latency. Thus Q-zero may comprise the entries stored by queue manager 606 in both the FIFO 700 and the DRAM 460. Likewise, information bound for FIFO 702, which may correspond to Q-twenty-seven, for example, can be moved by DMA into DRAM 460, as shown by arrow 735. The capacity for queuing in cost-effective albeit slower DRAM 460 is user-definable during initialization, allowing the queues to change in size as desired. Information queued in DRAM 460 is returned to SRAM unit 717, as shown by arrow 737.
Status for each of the thirty-two hardware queues is conveniently maintained in and accessed from a set 740 of four, thirty-two bit registers, as shown in FIG. 17, in which a specific bit in each register corresponds to a specific queue. The registers are labeled Q-Out_Ready 745, Q-In_Ready 750, Q-Empty 755 and Q-Full 760. If a particular bit is set in the Q-Out_Ready register 750, the queue corresponding to that bit contains information that is ready to be read, while the setting of the same bit in the Q-In_Ready 752 register means that the queue is ready to be written. Similarly, a positive setting of a specific bit in the Q-Empty register 755 means that the queue corresponding to that bit is empty, while a positive setting of a particular bit in the Q-Full register 760 means that the queue corresponding to that bit is full. Thus Q-Out_Ready 745 contains bits zero 746 through thirty-one 748, including bits twenty-seven 752, twenty-eight 754, twenty-nine 756 and thirty 758. Q-In_Ready 750 contains bits zero 762 through thirty-one 764, including bits twenty-seven 766, twenty-eight 768, twenty-nine 770 and thirty 772. Q-Empty 755 contains bits zero 774 through thirty-one 776, including bits twenty-seven 778, twenty-eight 780, twenty-nine 782 and thirty 784, and Q-full 760 contains bits zero 786 through thirty-one 788, including bits twenty-seven 790, twenty-eight 792, twenty-nine 794 and thirty 796.
Q-zero, corresponding to FIFO 700, is a free buffer queue, which holds a list of addresses for all available buffers. This queue is addressed when the microprocessor or other devices need a free buffer address, and so commonly includes appreciable DRAM 460. Thus a device needing a free buffer address would check with Q-zero to obtain that address. Q-twenty-seven, corresponding to FIFO 702, is a receive buffer descriptor queue. After processing a received frame by the receive sequencer the sequencer looks to store a descriptor for the frame in Q-twenty-seven. If a location for such a descriptor is immediately available in SRAM, bit twenty-seven 766 of Q-In_Ready 750 will be set. If not, the sequencer must wait for the queue manager to initiate a DMA move from SRAM to DRAM, thereby freeing space to store the receive descriptor.
Operation of the queue manager, which manages movement of queue entries between SRAM and the processor, the transmit and receive sequencers, and also between SRAM and DRAM, is shown in more detail in FIG. 18. Requests which utilize the queues include Processor Request 802, Transmit Sequencer Request 804, and Receive Sequencer Request 806. Other requests for the queues are DRAM to SRAM Request 808 and SRAM to DRAM Request 810, which operate on behalf of the queue manager in moving data back and forth between the DRAM and the SRAM head or tail of the queues. Determining which of these various requests will get to use the queue manager in the next cycle is handled by priority logic Arbiter 815. To enable high frequency operation the queue manager is pipelined, with Register A 818 and Register B 820 providing temporary storage, while Status Register 822 maintains status until the next update. The queue manager reserves even cycles for DMA, receive and transmit sequencer requests and odd cycles for processor requests. Dual ported QRAM 825 stores variables regarding each of the queues, the variables for each queue including a Head Write Pointer, Head Read Pointer, Tail Write Pointer and Tail Read Pointer corresponding to the queue's SRAM condition, and a Body Write Pointer and Body Read Pointer corresponding to the queue's DRAM condition and the queue's size.
After Arbiter 815 has selected the next operation to be performed, the variables of QRAM 825 are fetched and modified according to the selected operation by a QALU 828, and an SRAM Read Request 830 or an SRAM Write Request 840 may be generated. The variables are updated and the updated status is stored in Status Register 822 as well as QRAM 825. The status is also fed to Arbiter 815 to signal that the operation previously requested has been fulfilled, inhibiting duplication of requests. The Status Register 822 updates the four queue registers Q-Out_Ready 745, Q-In_Ready 750, Q-Empty 755 and Q-Full 760 to reflect the new status of the queue that was accessed. Similarly updated are SRAM Addresses 833, Body Write Request 835 and Body Read Requests 838, which are accessed via DMA to and from SRAM head and tails for that queue. Alternatively, various processes may wish to write to a queue, as shown by Q Write Data 844, which are selected by multiplexor 846, and pipelined to SRAM Write Request 840. The SRAM controller services the read and write requests by writing the tail or reading the head of the accessed queue and returning an acknowledge. In this manner the various queues are utilized and their status updated.
FIGS. 19A-C show a least-recently-used register 900 that is employed for choosing which contexts or CCBs to maintain in INIC cache memory. The INIC in this embodiment can cache up to sixteen CCBs in SRAM at a given time, and so when a new CCB is cached an old one must often be discarded, the discarded CCB usually chosen according to this register 900 to be the CCB that has been used least recently. In this embodiment, a hash table for up to two hundred fifty-six CCBs is also maintained in SRAM, while up to two hundred fifty-six full CCBs are held in DRAM. The least-recently-used register 900 contains sixteen four-bit blocks labeled R0-R15, each of which corresponds to an SRAM cache unit. Upon initialization, the blocks are numbered 0-15, with number 0 arbitrarily stored in the block representing the least recently used (LRU) cache unit and number 15 stored in the block representing the most recently used (MRU) cache unit. FIG. 19A shows the register 900 at an arbitrary time when the LRU block R0 holds the number 9 and the MRU block R15 holds the number 6.
When a different CCB than is currently being held in SRAM is to be cached, the LRU block R0 is read, which in FIG. 19A holds the number 9, and the new CCB is stored in the SRAM cache unit corresponding to number 9. Since the new CCB corresponding to number 9 is now the most recently used CCB, the number 9 is stored in the MRU block, as shown in FIG. 19B. The other numbers are all shifted one register block to the left, leaving the number 1 in the LRU block. The CCB that had previously been cached in the SRAM unit corresponding to number 9 has been moved to slower but more cost-effective DRAM.
FIG. 19C shows the result when the next CCB used had already been cached in SRAM. In this example, the CCB was cached in an SRAM unit corresponding to number 10, and so after employment of that CCB, number 10 is stored in the MRU block. Only those numbers which had previously been more recently used than number 10 (register blocks R9-R15) are shifted to the left, leaving the number 1 in the LRU block. In this manner the INIC maintains the most active CCBs in SRAM cache.
In some cases a CCB being used is one that is not desirable to hold in the limited cache memory. For example, it is preferable not to cache a CCB for a context that is known to be closing, so that other cached CCBs can remain in SRAM longer. In this case, the number representing the cache unit holding the decacheable CCB is stored in the LRU block R0 rather than the MRU block R15, so that the decacheable CCB will be replaced immediately upon employment of a new CCB that is cached in the SRAM unit corresponding to the number held in the LRU block R0. FIG. 19D shows the case for which number 8 (which had been in block R9 in FIG. 19C) corresponds to a CCB that will be used and then closed. In this case number 8 has been removed from block R9 and stored in the LRU block R0. All the numbers that had previously been stored to the left of block R9 (R1-R8) are then shifted one block to the right.
FIG. 20 shows some of the logical units employed to operate the least-recently-used register 900. An array of sixteen, three or four input multiplexors 910, of which only multiplexors MUX0, MUX7, MUX8, MUX9 and MUX15 are shown for clarity, have outputs fed into the corresponding sixteen blocks of least-recently-used register 900. For example, the output of MUX0 is stored in block R0, the output of MUX7 is stored in block R7, etc. The value of each of the register blocks is connected to an input for its corresponding multiplexor and also into inputs for both adjacent multiplexors, for use in shifting the block numbers. For instance, the number stored in R8 is fed into inputs for MUX7, MUX8 and MUX9. MUX0 and MUX15 each have only one adjacent block, and the extra input for those multiplexors is used for the selection of LRU and MRU blocks, respectively. MUX15 is shown as a four-input multiplexor, with input 915 providing the number stored on R0.
An array of sixteen comparators 920 each receives the value stored in the corresponding block of the least-recently-used register 900. Each comparator also receives a signal from processor 470 along line 935 so that the register block having a number matching that sent by processor 470 outputs true to logic circuits 930 while the other fifteen comparators output false. Logic circuits 930 control a pair of select lines leading to each of the multiplexors, for selecting inputs to the multiplexors and therefore controlling shifting of the register block numbers. Thus select lines 939 control MUX0, select lines 944 control MUX7, select lines 949 control MUX8, select lines 954 control MUX9 and select lines 959 control MUX15.
When a CCB is to be used, processor 470 checks to see whether the CCB matches a CCB currently held in one of the sixteen cache units. If a match is found, the processor sends a signal along line 935 with the block number corresponding to that cache unit, for example number 12. Comparators 920 compare the signal from that line 935 with the block numbers and comparator C8 provides a true output for the block R8 that matches the signal, while all the other comparators output false. Logic circuits 930, under control from the processor 470, use select lines 959 to choose the input from line 935 for MUX15, storing the number 12 in the MRU block R15. Logic circuits 930 also send signals along the pairs of select lines for MUX8 and higher multiplexors, aside from MUX15, to shift their output one block to the left, by selecting as inputs to each multiplexor MUX8 and higher the value that had been stored in register blocks one block to the right (R9-R15). The outputs of multiplexors that are to the left of MUX8 are selected to be constant.
If processor 470 does not find a match for the CCB among the sixteen cache units, on the other hand, the processor reads from LRU block R0 along line 966 to identify the cache corresponding to the LRU block, and writes the data stored in that cache to DRAM. The number that was stored in R0, in this case number 3, is chosen by select lines 959 as input 915 to MUX15 for storage in MRU block R15. The other fifteen multiplexors output to their respective register blocks the numbers that had been stored each register block immediately to the right.
For the situation in which the processor wishes to remove a CCB from the cache after use, the LRU block R0 rather than the MRU block R15 is selected for placement of the number corresponding to the cache unit holding that CCB. The number corresponding to the CCB to be placed in the LRU block R0 for removal from SRAM (for example number 1, held in block R9) is sent by processor 470 along line 935, which is matched by comparator C9. The processor instructs logic circuits 930 to input the number 1 to R0, by selecting with lines 939 input 935 to MUX0. Select lines 954 to MUX9 choose as input the number held in register block R8, so that the number from R8 is stored in R9. The numbers held by the other register blocks between R0 and R9 are similarly shifted to the right, whereas the numbers in register blocks to the right of R9 are left constant. This frees scarce cache memory from maintaining closed CCBs for many cycles while their identifying numbers move through register blocks from the MRU to the LRU blocks.
FIG. 21 is another diagram of Intelligent Network Interface Card (INIC) 200 of FIG. 13. INIC card 200 includes a Physical Layer Interface (PHY) chip 2100, ASIC chip 400 and Dynamic Random Access Memory (DRAM) 460. PHY chip 2100 couples INIC card 200 to network line 210 via a network connector 2101. INIC card 200 is coupled to the CPU of the host (for example, CPU 28 of host 20 of FIG. 1) via card edge connector 2107 and PCI bus 257. ASIC chip 400 includes a Media Access Control (MAC) unit 402, a sequencers block 2103, SRAM control 442, SRAM 440, DRAM control 450, a queue manager 2103, a processor 470, and a PCI bus interface unit 468. Structure and operation of queue manager 2103 is described above in connection with FIG. 18 and in U.S. patent application Ser. No. 09/416,925, entitled “Queue System For Microprocessors”, attorney docket no. ALA-005, filed Oct. 13, 1999, by Daryl D. Starr and Clive M. Philbrick (the subject matter of which is incorporated herein by reference). Sequencers block 2102 includes a transmit sequencer 2104, a receive sequencer 2105, and configuration registers 2106. A MAC destination address is stored in configuration register 2106. Part of the program code executed by processor 470 is contained in ROM (not shown) and part is located in a writeable control store SRAM (not shown). The program is downloaded into the writeable control store SRAM at initialization from the host 20.
FIG. 22 is a more detailed diagram of receive sequencer 2105. Receive sequencer 2105 includes a data synchronization buffer 2200, a packet synchronization sequencer 2201, a data assembly register 2202, a protocol analyzer 2203, a packet processing sequencer 2204, a queue manager interface 2205, and a Direct Memory Access (DMA) control block 2206. The packet synchronization sequencer 2201 and data synchronization buffer 2200 utilize a network-synchronized clock of MAC 402, whereas the remainder of the receive sequencer 2105 utilizes a fixed-frequency clock. Dashed line 2221 indicates the clock domain boundary.
CD Appendix A contains a complete hardware description (verilog code) of an embodiment of receive sequencer 2105. Signals in the verilog code are named to designate their functions. Individual sections of the verilog code are identified and labeled with comment lines. Each of these sections describes hardware in a block of the receive sequencer 2105 as set forth below in Table 1.
TABLE 1
SECTION OF VERILOG CODE BLOCK OF FIG. 22
Synchronization Interface 2201
Sync-Buffer Read-Ptr Synchronizers 2201
Packet-Synchronization Sequencer 2201
Data Synchronization Buffer 2201 and 2200
Synchronized Status for Link-Destination-Address 2201
Synchronized Status-Vector 2201
Synchronization Interface 2204
Receive Packet Control and Status 2204
Buffer-Descriptor 2201
Ending Packet Status 2201
AssyReg shift-in. Mac −> AssyReg. 2202 and 2204
Fifo shift-in. AssyReg −> Sram Fifo 2206
Fifo ShiftOut Burst. SramFifo −> DramBuffer 2206
Fly-By Protocol Analyzer; Frame, Network 2203
and Transport Layers
Link Pointer 2203
Mac address detection 2203
Magic pattern detection 2203
Link layer and network layer detection 2203
Network counter 2203
Control Packet analysis 2203
Network header analysis 2203
Transport layer counter 2203
Transport header analysis 2203
Pseudo-header stuff 2203
Free-Descriptor Fetch 2205
Receive-Descriptor Store 2205
Receive-Vector Store 2205
Queue-manager interface-mux 2205
Pause Clock Generator 2201
Pause Timer 2204
Operation of receive sequencer 2105 of FIGS. 21 and 22 is now described in connection with the receipt onto INIC card 200 of a TCP/IP packet from network line 210. At initialization time, processor 470 partitions DRAM 460 into buffers. Receive sequencer 2105 uses the buffers in DRAM 460 to store incoming network packet data as well as status information for the packet. Processor 470 creates a 32-bit buffer descriptor for each buffer. A buffer descriptor indicates the size and location in DRAM of its associated buffer. Processor 470 places these buffer descriptors on a “free-buffer queue” 2108 by writing the descriptors to the queue manager 2103. Queue manager 2103 maintains multiple queues including the “free-buffer queue” 2108. In this implementation, the heads and tails of the various queues are located in SRAM 440, whereas the middle portion of the queues are located in DRAM 460.
Lines 2229 comprise a request mechanism involving a request line and address lines. Similarly, lines 2230 comprise a request mechanism involving a request line and address lines. Queue manager 2103 uses lines 2229 and 2230 to issue requests to transfer queue information from DRAM to SRAM or from SRAM to DRAM.
The queue manager interface 2205 of the receive sequencer always attempts to maintain a free buffer descriptor 2207 for use by the packet processing sequencer 2204. Bit 2208 is a ready bit that indicates that free-buffer descriptor 2207 is available for use by the packet processing sequencer 2204. If queue manager interface 2205 does not have a free buffer descriptor (bit 2208 is not set), then queue manager interface 2205 requests one from queue manager 2103 via request line 2209. (Request line 2209 is actually a bus which communicates the request, a queue ID, a read/write signal and data if the operation is a write to the queue.)
In response, queue manager 2103 retrieves a free buffer descriptor from the tail of the “free buffer queue” 2108 and then alerts the queue manager interface 2205 via an acknowledge signal on acknowledge line 2210. When queue manager interface 2205 receives the acknowledge signal, the queue manager interface 2205 loads the free buffer descriptor 2207 and sets the ready bit 2208. Because the free buffer descriptor was in the tail of the free buffer queue in SRAM 440, the queue manager interface 2205 actually receives the free buffer descriptor 2207 from the read data bus 2228 of the SRAM control block 442. Packet processing sequencer 2204 requests a free buffer descriptor 2207 via request line 2211. When the queue manager interface 2205 retrieves the free buffer descriptor 2207 and the free buffer descriptor 2207 is available for use by the packet processing sequencer, the queue manager interface 2205 informs the packet processing sequencer 2204 via grant line 2212. By this process, a free buffer descriptor is made available for use by the packet processing sequencer 2204 and the receive sequencer 2105 is ready to processes an incoming packet.
Next, a TCP/IP packet is received from the network line 210 via network connector 2101 and Physical Layer Interface (PHY) 2100. PHY 2100 supplies the packet to MAC 402 via a Media Independent Interface (MII) parallel bus 2109. MAC 402 begins processing the packet and asserts a “start of packet” signal on line 2213 indicating that the beginning of a packet is being received. When a byte of data is received in the MAC and is available at the MAC outputs 2215, MAC 402 asserts a “data valid” signal on line 2214. Upon receiving the “data valid” signal, the packet synchronization sequencer 2201 instructs the data synchronization buffer 2200 via load signal line 2222 to load the received byte from data lines 2215. Data synchronization buffer 2200 is four bytes deep. The packet synchronization sequencer 2201 then increments a data synchronization buffer write pointer. This data synchronization buffer write pointer is made available to the packet processing sequencer 2204 via lines 2216. Consecutive bytes of data from data lines 2215 are clocked into the data synchronization buffer 2200 in this way.
A data synchronization buffer read pointer available on lines 2219 is maintained by the packet processing sequencer 2204. The packet processing sequencer 2204 determines that data is available in data synchronization buffer 2200 by comparing the data synchronization buffer write pointer on lines 2216 with the data synchronization buffer read pointer on lines 2219.
Data assembly register 2202 contains a sixteen-byte long shift register 2217. This register 2217 is loaded serially a single byte at a time and is unloaded in parallel. When data is loaded into register 2217, a write pointer is incremented. This write pointer is made available to the packet processing sequencer 2204 via lines 2218. Similarly, when data is unloaded from register 2217, a read pointer maintained by packet processing sequencer 2204 is incremented. This read pointer is available to the data assembly register 2202 via lines 2220. The packet processing sequencer 2204 can therefore determine whether room is available in register 2217 by comparing the write pointer on lines 2218 to the read pointer on lines 2220.
If the packet processing sequencer 2204 determines that room is available in register 2217, then packet processing sequencer 2204 instructs data assembly register 2202 to load a byte of data from data synchronization buffer 2200. The data assembly register 2202 increments the data assembly register write pointer on lines 2218 and the packet processing sequencer 2204 increments the data synchronization buffer read pointer on lines 2219. Data shifted into register 2217 is examined at the register outputs by protocol analyzer 2203 which verifies checksums, and generates “status” information 2223.
DMA control block 2206 is responsible for moving information from register 2217 to buffer 2114 via a sixty-four byte receive FIFO 2110. DMA control block 2206 implements receive FIFO 2110 as two thirty-two byte ping-pong buffers using sixty-four bytes of SRAM 440. DMA control block 2206 implements the receive FIFO using a write-pointer and a read-pointer. When data to be transferred is available in register 2217 and space is available in FIFO 2110, DMA control block 2206 asserts an SRAM write request to SRAM controller 442 via lines 2225. SRAM controller 442 in turn moves data from register 2217 to FIFO 2110 and asserts an acknowledge signal back to DMA control block 2206 via lines 2225. DMA control block 2206 then increments the receive FIFO write pointer and causes the data assembly register read pointer to be incremented.
When thirty-two bytes of data has been deposited into receive FIFO 2110, DMA control block 2206 presents a DRAM write request to DRAM controller 450 via lines 2226. This write request consists of the free buffer descriptor 2207 ORed with a “buffer load count” for the DRAM request address, and the receive FIFO read pointer for the SRAM read address. Using the receive FIFO read pointer, the DRAM controller 450 asserts a read request to SRAM controller 442. SRAM controller 442 responds to DRAM controller 450 by returning the indicated data from the receive FIFO 2110 in SRAM 440 and asserting an acknowledge signal. DRAM controller 450 stores the data in a DRAM write data register, stores a DRAM request address in a DRAM address register, and asserts an acknowledge to DMA control block 2206. The DMA control block 2206 then decrements the receive FIFO read pointer. Then the DRAM controller 450 moves the data from the DRAM write data register to buffer 2114. In this way, as consecutive thirty-two byte chunks of data are stored in SRAM 440, DRAM control block 2206 moves those thirty-two byte chunks of data one at a time from SRAM 440 to buffer 2214 in DRAM 460. Transferring thirty-two byte chunks of data to the DRAM 460 in this fashion allows data to be written into the DRAM using the relatively efficient burst mode of the DRAM.
Packet data continues to flow from network line 210 to buffer 2114 until all packet data has been received. MAC 402 then indicates that the incoming packet has completed by asserting an “end of frame” (i.e., end of packet) signal on line 2227 and by presenting final packet status (MAC packet status) to packet synchronization sequencer 2204. The packet processing sequencer 2204 then moves the status 2223 (also called “protocol analyzer status”) and the MAC packet status to register 2217 for eventual transfer to buffer 2114. After all the data of the packet has been placed in buffer 2214, status 2223 and the MAC packet status is transferred to buffer 2214 so that it is stored prepended to the associated data as shown in FIG. 22.
After all data and status has been transferred to buffer 2114, packet processing sequencer 2204 creates a summary 2224 (also called a “receive packet descriptor”) by concatenating the free buffer descriptor 2207, the buffer load-count, the MAC ID, and a status bit (also called an “attention bit”). If the attention bit is a one, then the packet is not a “fast-path candidate”; whereas if the attention bit is a zero, then the packet is a “fast-path candidate”. The value of the attention bit represents the result of a significant amount of processing that processor 470 would otherwise have to do to determine whether the packet is a “fast-path candidate”. For example, the attention bit being a zero indicates that the packet employs both TCP protocol and IP protocol. By carrying out this significant amount of processing in hardware beforehand and then encoding the result in the attention bit, subsequent decision making by processor 470 as to whether the packet is an actual “fast-path packet” is accelerated. A complete logical description of the attention bit in verilog code is set forth in CD Appendix A in the lines following the heading “Ending Packet Status”.
Packet processing sequencer 2204 then sets a ready bit (not shown) associated with summary 2224 and presents summary 2224 to queue manager interface 2205. Queue manager interface 2205 then requests a write to the head of a “summary queue” 2112 (also called the “receive descriptor queue”). The queue manager 2103 receives the request, writes the summary 2224 to the head of the summary queue 2212, and asserts an acknowledge signal back to queue manager interface via line 2210. When queue manager interface 2205 receives the acknowledge, queue manager interface 2205 informs packet processing sequencer 2204 that the summary 2224 is in summary queue 2212 by clearing the ready bit associated with the summary. Packet processing sequencer 2204 also generates additional status information (also called a “vector”) for the packet by concatenating the MAC packet status and the MAC ID. Packet processing sequencer 2204 sets a ready bit (not shown) associated with this vector and presents this vector to the queue manager interface 2205. The queue manager interface 2205 and the queue manager 2103 then cooperate to write this vector to the head of a “vector queue” 2113 in similar fashion to the way summary 2224 was written to the head of summary queue 2112 as described above. When the vector for the packet has been written to vector queue 2113, queue manager interface 2205 resets the ready bit associated with the vector.
Once summary 2224 (including a buffer descriptor that points to buffer 2114) has been placed in summary queue 2112 and the packet data has been placed in buffer 2144, processor 470 can retrieve summary 2224 from summary queue 2112 and examine the “attention bit”.
If the attention bit from summary 2224 is a digital one, then processor 470 determines that the packet is not a “fast-path candidate” and processor 470 need not examine the packet headers. Only the status 2223 (first sixteen bytes) from buffer 2114 are DMA transferred to SRAM so processor 470 can examine it. If the status 2223 indicates that the packet is a type of packet that is not to be transferred to the host (for example, a multicast frame that the host is not registered to receive), then the packet is discarded (i.e., not passed to the host). If status 2223 does not indicate that the packet is the type of packet that is not to be transferred to the host, then the entire packet (headers and data) is passed to a buffer on host 20 for “slow-path” transport and network layer processing by the protocol stack of host 20.
If, on the other hand, the attention bit is a zero, then processor 470 determines that the packet is a “fast-path candidate”. If processor 470 determines that the packet is a “fast-path candidate”, then processor 470 uses the buffer descriptor from the summary to DMA transfer the first approximately 96 bytes of information from buffer 2114 from DRAM 460 into a portion of SRAM 440 so processor 470 can examine it. This first approximately 96 bytes contains status 2223 as well as the IP source address of the IP header, the IP destination address of the IP header, the TCP source address of the TCP header, and the TCP destination address of the TCP header. The IP source address of the IP header, the IP destination address of the IP header, the TCP source address of the TCP header, and the TCP destination address of the TCP header together uniquely define a single connection context (TCB) with which the packet is associated. Processor 470 examines these addresses of the TCP and IP headers and determines the connection context of the packet. Processor 470 then checks a list of connection contexts that are under the control on INIC card 200 and determines whether the packet is associated with a connection context (TCB) under the control of INIC card 200.
If the connection context is not in the list, then the “fast-path candidate” packet is determined not to be a “fast-path packet.” In such a case, the entire packet (headers and data) is transferred to a buffer in host 20 for “slow-path” processing by the protocol stack of host 20.
If, on the other hand, the connection context is in the list, then software executed by processor 470 including software state machines 2231 and 2232 checks for one of numerous exception conditions and determines whether the packet is a “fast-path packet” or is not a “fast-path packet”. These exception conditions include: 1) IP fragmentation is detected; 2) an IP option is detected; 3) an unexpected TCP flag (urgent bit set, reset bit set, SYN bit set or FIN bit set) is detected; 4) the ACK field in the TCP header is before the TCP window, or the ACK field in the TCP header is after the TCP window, or the ACK field in the TCP header shrinks the TCP window; 5) the ACK field in the TCP header is a duplicate ACK and the ACK field exceeds the duplicate ACK count (the duplicate ACK count is a user settable value); and 6) the sequence number of the TCP header is out of order (packet is received out of sequence). If the software executed by processor 470 detects one of these exception conditions, then processor 470 determines that the “fast-path candidate” is not a “fast-path packet.” In such a case, the connection context for the packet is “flushed” (the connection context is passed back to the host) so that the connection context is no longer present in the list of connection contexts under control of INIC card 200. The entire packet (headers and data) is transferred to a buffer in host 20 for “slow-path” transport layer and network layer processing by the protocol stack of host 20.
If, on the other hand, processor 470 finds no such exception condition, then the “fast-path candidate” packet is determined to be an actual “fast-path packet”. The receive state machine 2232 then processes of the packet through TCP. The data portion of the packet in buffer 2114 is then transferred by another DMA controller (not shown in FIG. 21) from buffer 2114 to a host-allocated file cache in storage 35 of host 20. In one embodiment, host 20 does no analysis of the TCP and IP headers of a “fast-path packet”. All analysis of the TCP and IP headers of a “fast-path packet” is done on INIC card 20.
FIG. 23 is a diagram illustrating the transfer of data of “fast-path packets” (packets of a 64 k-byte session layer message 2300) from INIC 200 to host 20. The portion of the diagram to the left of the dashed line 2301 represents INIC 200, whereas the portion of the diagram to the right of the dashed line 2301 represents host 20. The 64 k-byte session layer message 2300 includes approximately forty-five packets, four of which (2302, 2303, 2304 and 2305) are labeled on FIG. 23. The first packet 2302 includes a portion 2306 containing transport and network layer headers (for example, TCP and IP headers), a portion 2307 containing a session layer header, and a portion 2308 containing data. In a first step, portion 2307, the first few bytes of data from portion 2308, and the connection context identifier 2310 of the packet 2300 are transferred from INIC 200 to a 256-byte buffer 2309 in host 20. In a second step, host 20 examines this information and returns to INIC 200 a destination (for example, the location of a file cache 2311 in storage 35) for the data. Host 20 also copies the first few bytes of the data from buffer 2309 to the beginning of a first part 2312 of file cache 2311. In a third step, INIC 200 transfers the remainder of the data from portion 2308 to host 20 such that the remainder of the data is stored in the remainder of first part 2312 of file cache 2311. No network, transport, or session layer headers are stored in first part 2312 of file cache 2311. Next, the data portion 2313 of the second packet 2303 is transferred to host 20 such that the data portion 2313 of the second packet 2303 is stored in a second part 2314 of file cache 2311. The transport layer and network layer header portion 2315 of second packet 2303 is not transferred to host 20. There is no network, transport, or session layer header stored in file cache 2311 between the data portion of first packet 2302 and the data portion of second packet 2303. Similarly, the data portion 2316 of the next packet 2304 of the session layer message is transferred to file cache 2311 so that there is no network, transport, or session layer headers between the data portion of the second packet 2303 and the data portion of the third packet 2304 in file cache 2311. In this way, only the data portions of the packets of the session layer message are placed in the file cache 2311. The data from the session layer message 2300 is present in file cache 2311 as a block such that this block contains no network, transport, or session layer headers.
In the case of a shorter, single-packet session layer message, portions 2307 and 2308 of the session layer message are transferred to 256-byte buffer 2309 of host 20 along with the connection context identifier 2310 as in the case of the longer session layer message described above. In the case of a single-packet session layer message, however, the transfer is completed at this point. Host 20 does not return a destination to INIC 200 and INIC 200 does not transfer subsequent data to such a destination.
CD Appendix B includes a listing of software executed by processor 470 that determines whether a “fast-path candidate” packet is or is not a “fast-path packet”. An example of the instruction set of processor 470 is found starting on page 79 of the Provisional U.S. Patent Application Ser. No. 60/061,809, entitled “Intelligent Network Interface Card And System For Protocol Processing”, filed Oct. 14, 1997 (the subject matter of this provisional application is incorporated herein by reference).
CD Appendix C includes device driver software executable on host 20 that interfaces the host 20 to INIC card 200. There is also ATCP code that executes on host 20. This ATCP code includes: 1) a “free BSD” stack (available from the University of California, Berkeley) that has been modified slightly to make it run on the NT4 operating system (the “free BSD” stack normally runs on a UNIX machine), and 2) code added to the free BSD stack between the session layer above and the device driver below that enables the BSD stack to carry out “fast-path” processing in conjunction with INIC 200.
TRANSMIT FAST-PATH PROCESSING: The following is an overview of one embodiment of a transmit fast-path flow once a command has been posted (for additional information, see provisional application 60/098,296, filed Aug. 27, 1998). The transmit request may be a segment that is less than the MSS, or it may be as much as a full 64 K session layer packet. The former request will go out as one segment, the latter as a number of MSS-sized segments. The transmitting CCB must hold on to the request until all data in it has been transmitted and ACKed. Appropriate pointers to do this are kept in the CCB. To create an output TCP/IP segment, a large DRAM buffer is acquired from the Q_FREEL queue. Then data is DMAd from host memory into the DRAM buffer to create an MSS-sized segment. This DMA also checksums the data. The TCP/IP header is created in SRAM and DMAd to the front of the payload data. It is quicker and simpler to keep a basic frame header (i.e., a template header) permanently in the CCB and DMA this directly from the SRAM CCB buffer into the DRAM buffer each time. Thus the payload checksum is adjusted for the pseudo-header (i.e., the template header) and placed into the TCP header prior to DMAing the header from SRAM. Then the DRAM buffer is queued to the appropriate Q_UXMT transmit queue. The final step is to update various window fields etc in the CCB. Eventually either the entire request will have been sent and ACKed, or a retransmission timer will expire in which case the context is flushed to the host. In either case, the INIC will place a command response in the response queue containing the command buffer from the original transmit command and appropriate status.
The above discussion has dealt with how an actual transmit occurs. However the real challenge in the transmit processor is to determine whether it is appropriate to transmit at the time a transmit request arrives, and then to continue to transmit for as long as the transport protocol permits. There are many reasons not to transmit: the receiver's window size is less than or equal to zero, the persist timer has expired, the amount to send is less than a full segment and an ACK is expected/outstanding, the receiver's window is not half-open, etc. Much of transmit processing will be in determining these conditions.
The fast-path is implemented as a finite state machine (FSM) that covers at least three layers of the protocol stack, i.e., IP, TCP, and Session. The following summarizes the steps involved in normal fast-path transmit command processing: 1) get control of the associated CCB (gotten from the command): this involves locking the CCB to stop other processing (e.g. Receive) from altering it while this transmit processing is taking place. 2) Get the CCB into an SRAM CCB buffer. There are sixteen of these buffers in SRAM and they are not flushed to DRAM until the buffer space is needed by other CCBs. Acquisition and flushing of these CCB buffers is controlled by a hardware LRU mechanism. Thus getting into a buffer may involve flushing another CCB from its SRAM buffer. 3) Process the send command (EX_SCMD) event against the CCB's FSM.
Each event and state intersection provides an action to be executed and a new state. The following is an example of the state/event transition, the action to be executed and the new state for the SEND command while in transmit state IDLE (SX_IDLE). The action from this state/event intersection is AX_NUCMD and the next state is XMIT COMMAND ACTIVE (SX_XMIT). To summarize, a command to transmit data has been received while transmit is currently idle. The action performs the following steps: 1) Store details of the command into the CCB. 2) Check that it is okay to transmit now (e.g. send window is not zero). 3) If output is not possible, send the Check Output event to Q_EVENT1 queue for the Transmit CCB's FSM and exit. 4) Get a DRAM 2 K-byte buffer from the Q-FREEL queue into which to move the payload data. 5) DMA payload data from the addresses in the scatter/gather lists in the command into an offset in the DRAM buffer that leaves space for the frame header. These DMAs will provide the checksum of the payload data. 6) Concurrently with the above DMA, fill out variable details in the frame header template in the CCB. Also get the IP and TCP header checksums while doing this. Note that base IP and TCP headers checksums are kept in the CCB, and these are simply updated for fields that vary per frame, viz. IP Id, IP length, IP checksum, TCP sequence and ACK numbers, TCP window size, TCP flags and TCP checksum. 7) When the payload is complete, DMA the frame header from the CCB to the front of the DRAM buffer. 8) Queue the DRAM buffer (i.e., queue a buffer descriptor that points to the DRAM buffer) to the appropriate Q_UXMT queue for the interface for this CCB. 9) Determine if there is more payload in the command. If so, save the current command transfer address details in the CCB and send a CHECK OUTPUT event via the Q_EVENT1 queue to the Transmit CCB. If not, send the ALL COMMAND DATA SENT (EX_ACDS) event to the Transmit CCB. 10) Exit from Transmit FSM processing.
Code that implements an embodiment of the Transmit FSM (transmit software state machine 2231 of FIG. 21) is found in CD Appendix B. In one embodiment, fast-path transmit processing is controlled using write only transmit configuration register (XmtCfg). Register XmtCfg has the following portions: 1) Bit 31 (name: Reset). Writing a one (1) will force reset asserted to the transmit sequencer of the channel selected by XcvSel. 2) Bit 30 (name: XmtEn). Writing a one (1) allows the transmit sequencer to run. Writing a zero (0) causes the transmit sequencer to halt after completion of the current packet. 3) Bit 29 (name: PauseEn). Writing a one (1) allows the transmit sequencer to stop packet transmission, after completion of the current packet, whenever the receive sequencer detects an 802.3 X pause command packet. 4) Bit 28 (name: LoadRng). Writing a one (1) causes the data in RcvAddrB[10:00] to be loaded in to the Mac's random number register for use during collision back-offs. 5) Bits 27:20 (name: Reserved). 6) Bits 19:15 (name: FreeQId). Selects the queue to which the freed buffer descriptors will be written once the packet transmission has been terminated, either successfully or unsuccessfully. 7) Bits 14:10 (name: XmtQId). Selects the queue from which the transmit buffer descriptors will be fetched for data packets. 8) Bits 09:05 (name: CtrlQId). Selects the queue from which the transmit buffer descriptors will be fetched for control packets. These packets have transmission priority over the data packets and will be exhausted before data packets will be transmitted. 9) Bits 04:00 (name: VectQId). Selects the queue to which the transmit vector data is written after the completion of each packet transmit. In some embodiments, transmit sequencer 2104 of FIG. 21 retrieves buffer descriptors from two transmit queues, one of the queues having a higher transmission priority than the other. The higher transmission priority transmit queue is used for the transmission of TCP ACKs, whereas the lower transmission priority transmit queue is used for the transmission of other types of packets. ACKs may be transmitted in accordance with techniques set forth in U.S. patent application Ser. No. 09/802,426 (the subject matter of which is incorporated herein by reference). In some embodiments, the processor that executes the Transmit FSM, the receive and transmit sequencers, and the host processor that executes the protocol stack are all realized on the same printed circuit board. The printed circuit board may, for example, be a card adapted for coupling to another computer.
All told, the above-described devices and systems for processing of data communication result in dramatic reductions in the time and host resources required for processing large, connection-based messages. Protocol processing speed and efficiency is tremendously accelerated by specially designed protocol processing hardware as compared with a general purpose CPU running conventional protocol software, and interrupts to the host CPU are also substantially reduced. These advantages can be provided to an existing host by addition of an intelligent network interface card (INIC), or the protocol processing hardware may be integrated with the CPU. In either case, the protocol processing hardware and CPU intelligently decide which device processes a given message, and can change the allocation of that processing based upon conditions of the message.

Claims (22)

What is claimed is:
1. An apparatus that communicates over a network, the apparatus comprising:
a processor executing a protocol processing stack to establish a TCP connection, the protocol processing stack including a TCP layer; and
a device that is coupled to the processor to receive a packet from the network, the device including a hardware processing mechanism to analyze at least a TCP header of the packet and determine TCP source and destination parts for the packet, the device using the TCP source and destination ports to determine whether the packet corresponds to the TCP connection.
2. The apparatus of claim 1, wherein control of the TCP connection is held by the device.
3. The apparatus of claim 1, wherein control of the TCP connection is held by the processor.
4. The system of claim 1, wherein the TCP connection is identified by an IP source address, an IP destination address, a TCP source port and a TCP destination port.
5. The apparatus of claim 1, wherein the packet includes data, and the device sends the data without the TCP header to a destination associated with the TCP connection upon determining that the packet corresponds to the TCP connection.
6. The apparatus of claim 1, wherein an application program provides a destination address, and a data payload of the packet is transferred directly from the device to the destination address.
7. The apparatus of claim 1, wherein the packet includes an upper layer header that is processed by the processor.
8. The apparatus of claim 1, wherein the device comprises an application specific integrated circuit (ASIC), and the processing mechanism is a part of the ASIC.
9. An apparatus that communicates over a network, the apparatus comprising:
a processor that executes a protocol processing stack and establishes a TCP connection, the protocol processing stack including a TCP layer, and
a device that is coupled to the processor and includes a processing mechanism that classifies a packet received by the device from the network, the packet containing control information including at least a transport layer header and a network layer header, the processing mechanism analyzing the control information without interruption between the transport layer header and the network layer header, to determine whether the packet corresponds to the TCP connection.
10. The apparatus of claim 9, wherein control of the TCP connection is held by the device.
11. The apparatus of claim 9, wherein control of the TCP connection is held by the processor.
12. The apparatus of claim 9, wherein the TCP connection is identified by an IP source address, an IP destination address, a TCP source port and a TCP destination port.
13. The apparatus of claim 9, wherein the packet includes data, and the device sends the data to a destination associated with the TCP connection upon determining that the packet corresponds to the TCP connection.
14. The apparatus of claim 9, wherein an application program provides a destination address, and a data payload of the packet is transferred directly from the device to the destination address.
15. The apparatus of claim 9, wherein the control information includes an upper layer header that is processed by the processor.
16. The apparatus of claim 9, wherein the device comprises an application specific integrated circuit (ASIC), and the processing mechanism is a part of the ASIC.
17. An apparatus that communicates over a network, the apparatus comprising;
a processor that executes a protocol processing stack to establish a TCP connection, the protocol processing stack including a TCP layer, and
a device coupled to the processor and including a hardware processing mechanism having means for classifying a packet received by the device from the network including means for determining TCP source and destination ports for the packet, the device determining whether the packet corresponds to the TCP connection.
18. The apparatus of claim 17, wherein the processor has means for causing control of the TCP connection to be passed to the device.
19. The apparatus of claim 18, wherein the device has means for causing control of the TCP connection to be passed to the processor.
20. The apparatus of claim 17, wherein the TCP connection is identified by an IP source address, an IP destination address, a TCP source port and a TCP destination port.
21. The apparatus of claim 17, wherein the packet includes a header and data, and the device sends the data to a destination associated with the TCP connection upon determining that the packet corresponds to the TCP connection.
22. The apparatus of claim 17, wherein the TCP connection has a state that is updated by the device.
US10/092,967 1997-10-14 2002-03-06 Fast-path apparatus for receiving data corresponding to a TCP connection Expired - Lifetime US6591302B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US10/092,967 US6591302B2 (en) 1997-10-14 2002-03-06 Fast-path apparatus for receiving data corresponding to a TCP connection
US10/246,820 US7284070B2 (en) 1997-10-14 2002-09-17 TCP offload network interface device
US11/821,820 US7673072B2 (en) 1997-10-14 2007-06-25 Fast-path apparatus for transmitting data corresponding to a TCP connection

Applications Claiming Priority (20)

Application Number Priority Date Filing Date Title
US6180997P 1997-10-14 1997-10-14
US09/067,544 US6226680B1 (en) 1997-10-14 1998-04-27 Intelligent network interface system method for protocol processing
US9829698P 1998-08-27 1998-08-27
US09/141,713 US6389479B1 (en) 1997-10-14 1998-08-28 Intelligent network interface device and system for accelerated communication
US09/384,792 US6434620B1 (en) 1998-08-27 1999-08-27 TCP/IP offload network interface device
US09/416,925 US6470415B1 (en) 1999-10-13 1999-10-13 Queue system involving SRAM head, SRAM tail and DRAM body
US09/439,603 US6247060B1 (en) 1997-10-14 1999-11-12 Passing a communication control block from host to a local device such that a message is processed on the device
US09/464,283 US6427173B1 (en) 1997-10-14 1999-12-15 Intelligent network interfaced device and system for accelerated communication
US09/514,425 US6427171B1 (en) 1997-10-14 2000-02-28 Protocol processing stack for use with intelligent network interface device
US09/675,484 US6807581B1 (en) 2000-09-29 2000-09-29 Intelligent network storage interface system
US09/675,700 US8621101B1 (en) 2000-09-29 2000-09-29 Intelligent network storage interface device
US09/789,366 US6757746B2 (en) 1997-10-14 2001-02-20 Obtaining a destination address so that a network interface device can write network data without headers directly into host memory
US09/801,488 US6687758B2 (en) 2001-03-07 2001-03-07 Port aggregation for network connections that are offloaded to network interface devices
US09/802,551 US7076568B2 (en) 1997-10-14 2001-03-09 Data communication apparatus for computer intelligent network interface card which transfers data between a network and a storage device according designated uniform datagram protocol socket
US09/802,426 US7042898B2 (en) 1997-10-14 2001-03-09 Reducing delays associated with inserting a checksum into a network message
US09/802,550 US6658480B2 (en) 1997-10-14 2001-03-09 Intelligent network interface system and method for accelerated protocol processing
US09/855,979 US7133940B2 (en) 1997-10-14 2001-05-14 Network interface device employing a DMA command queue
US09/970,124 US7124205B2 (en) 1997-10-14 2001-10-02 Network interface device that fast-path processes solicited session layer read commands
US10/023,240 US6965941B2 (en) 1997-10-14 2001-12-17 Transmit fast-path processing on TCP/IP offload network interface device
US10/092,967 US6591302B2 (en) 1997-10-14 2002-03-06 Fast-path apparatus for receiving data corresponding to a TCP connection

Related Parent Applications (4)

Application Number Title Priority Date Filing Date
US09/384,792 Continuation-In-Part US6434620B1 (en) 1997-10-14 1999-08-27 TCP/IP offload network interface device
US09/464,283 Continuation-In-Part US6427173B1 (en) 1997-10-14 1999-12-15 Intelligent network interfaced device and system for accelerated communication
US09/514,425 Continuation-In-Part US6427171B1 (en) 1997-10-14 2000-02-28 Protocol processing stack for use with intelligent network interface device
US10/023,240 Continuation-In-Part US6965941B2 (en) 1997-10-14 2001-12-17 Transmit fast-path processing on TCP/IP offload network interface device

Related Child Applications (4)

Application Number Title Priority Date Filing Date
US09/384,792 Continuation-In-Part US6434620B1 (en) 1997-10-14 1999-08-27 TCP/IP offload network interface device
US09/439,603 Continuation-In-Part US6247060B1 (en) 1997-10-14 1999-11-12 Passing a communication control block from host to a local device such that a message is processed on the device
US10/246,820 Continuation-In-Part US7284070B2 (en) 1997-10-14 2002-09-17 TCP offload network interface device
US10/260,112 Continuation US7237036B2 (en) 1997-10-14 2002-09-27 Fast-path apparatus for receiving data corresponding a TCP connection

Publications (2)

Publication Number Publication Date
US20020147839A1 US20020147839A1 (en) 2002-10-10
US6591302B2 true US6591302B2 (en) 2003-07-08

Family

ID=27586291

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/092,967 Expired - Lifetime US6591302B2 (en) 1997-10-14 2002-03-06 Fast-path apparatus for receiving data corresponding to a TCP connection

Country Status (1)

Country Link
US (1) US6591302B2 (en)

Cited By (161)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020112085A1 (en) * 2000-12-21 2002-08-15 Berg Mitchell T. Method and system for communicating an information packet through multiple networks
US20020112087A1 (en) * 2000-12-21 2002-08-15 Berg Mitchell T. Method and system for establishing a data structure of a connection with a client
US20020116475A1 (en) * 2000-12-21 2002-08-22 Berg Mitchell T. Method and system for communicating a request packet in response to a state
US20020120888A1 (en) * 2001-02-14 2002-08-29 Jorg Franke Network co-processor for vehicles
US20020120761A1 (en) * 2000-12-21 2002-08-29 Berg Mitchell T. Method and system for executing protocol stack instructions to form a packet for causing a computing device to perform an operation
US20030009651A1 (en) * 2001-05-15 2003-01-09 Zahid Najam Apparatus and method for interconnecting a processor to co-processors using shared memory
US20030031172A1 (en) * 2001-05-31 2003-02-13 Ron Grinfeld TCP receiver acceleration
US20030165160A1 (en) * 2001-04-24 2003-09-04 Minami John Shigeto Gigabit Ethernet adapter
US20030169744A1 (en) * 2002-03-07 2003-09-11 Uri Elzur Receiver-aided set-up request routing
US20030204631A1 (en) * 2002-04-30 2003-10-30 Microsoft Corporation Method to synchronize and upload an offloaded network stack connection with a network stack
US20030223433A1 (en) * 2002-04-08 2003-12-04 Jung-Tae Lee Internet protocol system using hardware protocol processing logic and parallel data processing method using the same
US20030222216A1 (en) * 2000-03-22 2003-12-04 Walkenstein Jonathan A. Low light imaging device
US20040042487A1 (en) * 2002-08-19 2004-03-04 Tehuti Networks Inc. Network traffic accelerator system and method
US20040049591A1 (en) * 2002-09-11 2004-03-11 Fan Kan Frankie System and method for TCP offloading and uploading
US20040064815A1 (en) * 2002-08-16 2004-04-01 Silverback Systems, Inc. Apparatus and method for transmit transport protocol termination
US20040062267A1 (en) * 2002-03-06 2004-04-01 Minami John Shigeto Gigabit Ethernet adapter supporting the iSCSI and IPSEC protocols
US20040172485A1 (en) * 2001-04-11 2004-09-02 Kianoosh Naghshineh Multi-purpose switching network interface controller
US20040213290A1 (en) * 1998-06-11 2004-10-28 Johnson Michael Ward TCP/IP/PPP modem
US20040249881A1 (en) * 2003-06-05 2004-12-09 Jha Ashutosh K. Transmitting commands and information between a TCP/IP stack and an offload unit
US20050016386A1 (en) * 2003-06-19 2005-01-27 Seb S.A. Device for filtration of the frying bath in an electric fryer having an immersed heating resistor
US20050071490A1 (en) * 1987-01-12 2005-03-31 Craft Peter K. Method to synchronize and upload an offloaded network stack connection with a network stack
US20050160139A1 (en) * 1997-10-14 2005-07-21 Boucher Laurence B. Network interface device that can transfer control of a TCP connection to a host CPU
US20050180322A1 (en) * 2003-07-15 2005-08-18 Lok Ying P. TCP time stamp processing in hardware based TCP offload
US20050198400A1 (en) * 2003-12-30 2005-09-08 Intel Corporation, A Delaware Corporation Systems and methods using nic-based prefetching for host TCP context lookup
US20050195833A1 (en) * 2004-03-02 2005-09-08 Hsin-Chieh Chiang Full hardware based TCP/IP traffic offload engine(TOE) device and the method thereof
US6944670B2 (en) * 2002-03-13 2005-09-13 Commatch Ltd. Method and apparatus for multiple processing of a plurality of communication protocols on a single processing machine
US20050246450A1 (en) * 2004-04-28 2005-11-03 Yutaka Enko Network protocol processing device
US20050271042A1 (en) * 2000-11-10 2005-12-08 Michael Johnson Internet modem streaming socket method
US20060002210A1 (en) * 2004-06-30 2006-01-05 David Thomas S Ethernet controller with excess on-board flash for microcontroller interface
US20060004926A1 (en) * 2004-06-30 2006-01-05 David Thomas S Smart buffer caching using look aside buffer for ethernet
US20060005196A1 (en) * 2004-07-02 2006-01-05 Seagate Technology Llc Resource allocation in a computer-based system
US20060023731A1 (en) * 2004-07-29 2006-02-02 Eduardo Asbun Method and apparatus for processing data in a communication system
US20060031818A1 (en) * 1997-05-08 2006-02-09 Poff Thomas C Hardware accelerator for an object-oriented programming language
US20060047904A1 (en) * 2004-09-01 2006-03-02 Derek Rohde Method and system for processing markers, data integrity fields and digests
US20060047868A1 (en) * 2004-09-01 2006-03-02 Derek Rohde Method and system for efficiently using buffer space
US20060056406A1 (en) * 2004-09-10 2006-03-16 Cavium Networks Packet queuing, scheduling and ordering
US20060075165A1 (en) * 2004-10-01 2006-04-06 Hui Ben K Method and system for processing out of order frames
US20060092934A1 (en) * 2004-10-29 2006-05-04 Industrial Technology Research Institute System for protocol processing engine
US20060123123A1 (en) * 2004-12-08 2006-06-08 Electronics And Telecommunications Research Institute Hardware device and method for creation and management of toe-based socket information
US7062574B1 (en) * 1999-07-01 2006-06-13 Agere Systems Inc. System and method for selectively detaching point-to-point protocol header information
US20060129697A1 (en) * 2000-04-17 2006-06-15 Mark Vange System and method for implementing application functionality within a network infrastructure
US20060212777A1 (en) * 2005-03-14 2006-09-21 Fujitsu Limited Medium storage device and write path diagnosis method
US20060227811A1 (en) * 2005-04-08 2006-10-12 Hussain Muhammad R TCP engine
US20060282560A1 (en) * 2005-06-08 2006-12-14 Intel Corporation Method and apparatus to reduce latency and improve throughput of input/output data in a processor
US20070061437A1 (en) * 2000-12-21 2007-03-15 Berg Mitchell T Method and system for identifying a computing device in response to an information packet
US20070064724A1 (en) * 2001-01-26 2007-03-22 Minami John S Offload system, method, and computer program product for processing network communications associated with a plurality of ports
US20070073966A1 (en) * 2005-09-23 2007-03-29 Corbin John R Network processor-based storage controller, compute element and method of using same
US20070118665A1 (en) * 1997-10-14 2007-05-24 Philbrick Clive M TCP/IP offload device with fast-path TCP ACK generating and transmitting mechanism
US20070140297A1 (en) * 2005-12-16 2007-06-21 Shen-Ming Chung Extensible protocol processing system
US20070165672A1 (en) * 2006-01-19 2007-07-19 Neteffect, Inc. Apparatus and method for stateless CRC calculation
US7269666B1 (en) * 2000-06-30 2007-09-11 Intel Corporation Memory utilization in a network interface
US20070253430A1 (en) * 2002-04-23 2007-11-01 Minami John S Gigabit Ethernet Adapter
US20070263620A1 (en) * 2006-05-15 2007-11-15 Chih-Feng Chien Method and Network Device for Fast Look-up in a Connection-oriented Communication
US7324547B1 (en) 2002-12-13 2008-01-29 Nvidia Corporation Internet protocol (IP) router residing in a processor chipset
US20080040519A1 (en) * 2006-05-02 2008-02-14 Alacritech, Inc. Network interface device with 10 Gb/s full-duplex transfer rate
US20080056124A1 (en) * 2003-06-05 2008-03-06 Sameer Nanda Using TCP/IP offload to accelerate packet filtering
US7362772B1 (en) 2002-12-13 2008-04-22 Nvidia Corporation Network processing pipeline chipset for routing and host packet processing
US20080133798A1 (en) * 2006-12-04 2008-06-05 Electronics And Telecommunications Research Institute Packet receiving hardware apparatus for tcp offload engine and receiving system and method using the same
US7389462B1 (en) 2003-02-14 2008-06-17 Istor Networks, Inc. System and methods for high rate hardware-accelerated network protocol processing
US7403542B1 (en) 2002-07-19 2008-07-22 Qlogic, Corporation Method and system for processing network data packets
US20080263171A1 (en) * 2007-04-19 2008-10-23 Alacritech, Inc. Peripheral device that DMAS the same data to different locations in a computer
US7460473B1 (en) 2003-02-14 2008-12-02 Istor Networks, Inc. Network receive interface for high bandwidth hardware-accelerated packet processing
US7512663B1 (en) 2003-02-18 2009-03-31 Istor Networks, Inc. Systems and methods of directly placing data in an iSCSI storage device
US20090182868A1 (en) * 2000-04-17 2009-07-16 Mcfate Marlin Popeye Automated network infrastructure test and diagnostic system and method therefor
US20090187669A1 (en) * 2000-04-17 2009-07-23 Randy Thornton System and method for reducing traffic and congestion on distributed interactive simulation networks
US7616563B1 (en) 2005-08-31 2009-11-10 Chelsio Communications, Inc. Method to implement an L4-L7 switch using split connections and an offloading NIC
US7640298B2 (en) 2000-12-21 2009-12-29 Berg Mitchell T Method and system for communicating an information packet through multiple router devices
US7639715B1 (en) 2005-09-09 2009-12-29 Qlogic, Corporation Dedicated application interface for network systems
US7646767B2 (en) 2003-07-21 2010-01-12 Qlogic, Corporation Method and system for programmable data dependant network routing
US20100011116A1 (en) * 2000-04-17 2010-01-14 Randy Thornton Dynamic network link acceleration
US7660306B1 (en) 2006-01-12 2010-02-09 Chelsio Communications, Inc. Virtualizing the operation of intelligent network interface circuitry
US7660264B1 (en) 2005-12-19 2010-02-09 Chelsio Communications, Inc. Method for traffic schedulign in intelligent network interface circuitry
US7664883B2 (en) 1998-08-28 2010-02-16 Alacritech, Inc. Network interface device that fast-path processes solicited session layer read commands
US7669190B2 (en) 2004-05-18 2010-02-23 Qlogic, Corporation Method and system for efficiently recording processor events in host bus adapters
US7673072B2 (en) 1997-10-14 2010-03-02 Alacritech, Inc. Fast-path apparatus for transmitting data corresponding to a TCP connection
US7698413B1 (en) 2004-04-12 2010-04-13 Nvidia Corporation Method and apparatus for accessing and maintaining socket control information for high speed network connections
US7715436B1 (en) 2005-11-18 2010-05-11 Chelsio Communications, Inc. Method for UDP transmit protocol offload processing with traffic management
US7724658B1 (en) 2005-08-31 2010-05-25 Chelsio Communications, Inc. Protocol offload transmit traffic management
US7729288B1 (en) 2002-09-11 2010-06-01 Qlogic, Corporation Zone management in a multi-module fibre channel switch
US7738500B1 (en) 2005-12-14 2010-06-15 Alacritech, Inc. TCP timestamp synchronization for network connections that are offloaded to network interface devices
US7760733B1 (en) 2005-10-13 2010-07-20 Chelsio Communications, Inc. Filtering ingress packets in network interface circuitry
US20100228901A1 (en) * 2003-08-12 2010-09-09 Takashi Tamura Input output control apparatus with a plurality of ports and single protocol processing circuit
US7813367B2 (en) * 2002-05-06 2010-10-12 Foundry Networks, Inc. Pipeline method and system for switching packets
US7817659B2 (en) 2004-03-26 2010-10-19 Foundry Networks, Llc Method and apparatus for aggregating input data streams
US7826350B1 (en) 2007-05-11 2010-11-02 Chelsio Communications, Inc. Intelligent network adaptor with adaptive direct data placement scheme
US7831745B1 (en) 2004-05-25 2010-11-09 Chelsio Communications, Inc. Scalable direct memory access using validation of host and scatter gather engine (SGE) generation indications
US7831720B1 (en) 2007-05-17 2010-11-09 Chelsio Communications, Inc. Full offload of stateful connections, with partial connection offload
US7830884B2 (en) 2002-05-06 2010-11-09 Foundry Networks, Llc Flexible method for processing data packets in a network routing system for enhanced efficiency and monitoring capability
US7853723B2 (en) 1997-10-14 2010-12-14 Alacritech, Inc. TCP/IP offload network interface device
US20100332694A1 (en) * 2006-02-17 2010-12-30 Sharp Robert O Method and apparatus for using a single multi-function adapter with different operating systems
US7899913B2 (en) 2003-12-19 2011-03-01 Nvidia Corporation Connection management system and method for a transport offload engine
US7903654B2 (en) 2006-08-22 2011-03-08 Foundry Networks, Llc System and method for ECMP load sharing
US7930377B2 (en) 2004-04-23 2011-04-19 Qlogic, Corporation Method and system for using boot servers in networks
US20110099243A1 (en) * 2006-01-19 2011-04-28 Keels Kenneth G Apparatus and method for in-line insertion and removal of markers
US7945699B2 (en) 1997-10-14 2011-05-17 Alacritech, Inc. Obtaining a destination address so that a network interface device can write network data without headers directly into host memory
US7948872B2 (en) 2000-11-17 2011-05-24 Foundry Networks, Llc Backplane interface adapter with error control and redundant fabric
US7953923B2 (en) 2004-10-29 2011-05-31 Foundry Networks, Llc Double density content addressable memory (CAM) lookup scheme
US7978702B2 (en) 2000-11-17 2011-07-12 Foundry Networks, Llc Backplane interface adapter
US7978614B2 (en) 2007-01-11 2011-07-12 Foundry Network, LLC Techniques for detecting non-receipt of fault detection protocol packets
US8019901B2 (en) 2000-09-29 2011-09-13 Alacritech, Inc. Intelligent network storage interface system
US8037399B2 (en) 2007-07-18 2011-10-11 Foundry Networks, Llc Techniques for segmented CRC design in high speed networks
US8041735B1 (en) 2002-11-01 2011-10-18 Bluearc Uk Limited Distributed file system and method
US8060644B1 (en) 2007-05-11 2011-11-15 Chelsio Communications, Inc. Intelligent network adaptor with end-to-end flow control
US8065439B1 (en) 2003-12-19 2011-11-22 Nvidia Corporation System and method for using metadata in the context of a transport offload engine
US8090901B2 (en) 2009-05-14 2012-01-03 Brocade Communications Systems, Inc. TCAM management approach that minimize movements
US8135842B1 (en) 1999-08-16 2012-03-13 Nvidia Corporation Internet jack
US8149839B1 (en) 2007-09-26 2012-04-03 Foundry Networks, Llc Selection of trunk ports and paths using rotation
US8176545B1 (en) 2003-12-19 2012-05-08 Nvidia Corporation Integrated policy checking system and method
US8180897B2 (en) 1999-10-14 2012-05-15 Bluearc Uk Limited Apparatus and method for hardware implementation or acceleration of operating system functions
US8224877B2 (en) 2002-11-01 2012-07-17 Bluearc Uk Limited Apparatus and method for hardware-based file system
US8238255B2 (en) 2006-11-22 2012-08-07 Foundry Networks, Llc Recovering from failures without impact on data traffic in a shared bus architecture
US8248939B1 (en) 2004-10-08 2012-08-21 Alacritech, Inc. Transferring control of TCP connections between hierarchy of processing mechanisms
US8271859B2 (en) 2007-07-18 2012-09-18 Foundry Networks Llc Segmented CRC design in high speed networks
US8316156B2 (en) 2006-02-17 2012-11-20 Intel-Ne, Inc. Method and apparatus for interfacing device drivers to single multi-function adapter
US8341286B1 (en) 2008-07-31 2012-12-25 Alacritech, Inc. TCP offload send optimization
EP2552080A2 (en) 2006-07-10 2013-01-30 Solarflare Communications Inc Chimney onload implementation of network protocol stack
US20130103852A1 (en) * 2010-06-30 2013-04-25 Heeyoung Jung Communication node and communication method
US8448162B2 (en) 2005-12-28 2013-05-21 Foundry Networks, Llc Hitless software upgrades
US8510468B2 (en) 2000-04-17 2013-08-13 Ciradence Corporation Route aware network link acceleration
US8539513B1 (en) 2008-04-01 2013-09-17 Alacritech, Inc. Accelerating data transfer in a virtual computer system with tightly coupled TCP connections
US8539112B2 (en) 1997-10-14 2013-09-17 Alacritech, Inc. TCP/IP offload device
US8549170B2 (en) 2003-12-19 2013-10-01 Nvidia Corporation Retransmission system and method for a transport offload engine
US8589587B1 (en) 2007-05-11 2013-11-19 Chelsio Communications, Inc. Protocol offload in intelligent network adaptor, including application level signalling
US8599850B2 (en) 2009-09-21 2013-12-03 Brocade Communications Systems, Inc. Provisioning single or multistage networks using ethernet service instances (ESIs)
US8621101B1 (en) 2000-09-29 2013-12-31 Alacritech, Inc. Intelligent network storage interface device
US8631140B2 (en) 1997-10-14 2014-01-14 Alacritech, Inc. Intelligent network interface system and method for accelerated protocol processing
US8671219B2 (en) 2002-05-06 2014-03-11 Foundry Networks, Llc Method and apparatus for efficiently processing data packets in a computer network
US8718051B2 (en) 2003-05-15 2014-05-06 Foundry Networks, Llc System and method for high speed packet transmission
US8730961B1 (en) 2004-04-26 2014-05-20 Foundry Networks, Llc System and method for optimizing router lookup
US20140180904A1 (en) * 2012-03-27 2014-06-26 Ip Reservoir, Llc Offload Processing of Data Packets Containing Financial Market Data
US8782199B2 (en) 1997-10-14 2014-07-15 A-Tech Llc Parsing a packet header
US20140310405A1 (en) * 2010-12-09 2014-10-16 Solarflare Communications, Inc. Tcp processing for devices
US8898340B2 (en) 2000-04-17 2014-11-25 Circadence Corporation Dynamic network link acceleration for network including wireless communication devices
US8935406B1 (en) * 2007-04-16 2015-01-13 Chelsio Communications, Inc. Network adaptor configured for connection establishment offload
US8996705B2 (en) 2000-04-17 2015-03-31 Circadence Corporation Optimization of enhanced network links
US9055104B2 (en) 2002-04-22 2015-06-09 Alacritech, Inc. Freeing transmit memory on a network interface device prior to receiving an acknowledgment that transmit data has been received by a remote device
US9258390B2 (en) 2011-07-29 2016-02-09 Solarflare Communications, Inc. Reducing network latency
US9306793B1 (en) 2008-10-22 2016-04-05 Alacritech, Inc. TCP offload device that batches session layer headers to reduce interrupts as well as CPU copies
US9600429B2 (en) 2010-12-09 2017-03-21 Solarflare Communications, Inc. Encapsulated accelerator
US9621964B2 (en) 2012-09-30 2017-04-11 Oracle International Corporation Aborting data stream using a location value
US9880964B2 (en) 2010-12-09 2018-01-30 Solarflare Communications, Inc. Encapsulated accelerator
US9893997B2 (en) 2016-04-07 2018-02-13 Nxp Usa,Inc. System and method for creating session entry
US9990393B2 (en) 2012-03-27 2018-06-05 Ip Reservoir, Llc Intelligent feed switch
US10033840B2 (en) 2000-04-17 2018-07-24 Circadence Corporation System and devices facilitating dynamic network link acceleration
US10037568B2 (en) 2010-12-09 2018-07-31 Ip Reservoir, Llc Method and apparatus for managing orders in financial markets
US10062115B2 (en) 2008-12-15 2018-08-28 Ip Reservoir, Llc Method and apparatus for high-speed processing of financial market depth data
US10121196B2 (en) 2012-03-27 2018-11-06 Ip Reservoir, Llc Offload processing of data packets containing financial market data
US10169814B2 (en) 2006-06-19 2019-01-01 Ip Reservoir, Llc High speed processing of financial information using FPGA devices
US10440158B2 (en) * 2016-06-01 2019-10-08 Intel IP Corporation Data processing device and method for offloading data to remote data processing device
US10505747B2 (en) 2012-10-16 2019-12-10 Solarflare Communications, Inc. Feed processing
US10580518B2 (en) 2005-03-03 2020-03-03 Washington University Method and apparatus for performing similarity searching
US10650452B2 (en) 2012-03-27 2020-05-12 Ip Reservoir, Llc Offload processing of data packets
US10659555B2 (en) 2018-07-17 2020-05-19 Xilinx, Inc. Network interface device and host processing device
US10686872B2 (en) 2017-12-19 2020-06-16 Xilinx, Inc. Network interface device
US10686731B2 (en) 2017-12-19 2020-06-16 Xilinx, Inc. Network interface device
US10838763B2 (en) 2018-07-17 2020-11-17 Xilinx, Inc. Network interface device and host processing device
US10873613B2 (en) 2010-12-09 2020-12-22 Xilinx, Inc. TCP processing for devices
US10909623B2 (en) 2002-05-21 2021-02-02 Ip Reservoir, Llc Method and apparatus for processing financial information at hardware speeds using FPGA devices
US11165720B2 (en) 2017-12-19 2021-11-02 Xilinx, Inc. Network interface device
US11436672B2 (en) 2012-03-27 2022-09-06 Exegy Incorporated Intelligent switch for processing financial market data
US11665087B2 (en) 2021-09-15 2023-05-30 International Business Machines Corporation Transparent service-aware multi-path networking with a feature of multiplexing

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7149817B2 (en) * 2001-02-15 2006-12-12 Neteffect, Inc. Infiniband TM work queue to TCP/IP translation
US20030115350A1 (en) * 2001-12-14 2003-06-19 Silverback Systems, Inc. System and method for efficient handling of network data
US20040167985A1 (en) * 2003-02-21 2004-08-26 Adescom, Inc. Internet protocol access controller
US8161197B2 (en) * 2003-12-19 2012-04-17 Broadcom Corporation Method and system for efficient buffer management for layer 2 (L2) through layer 5 (L5) network interface controller applications
US7957379B2 (en) 2004-10-19 2011-06-07 Nvidia Corporation System and method for processing RX packets in high speed network applications using an RX FIFO buffer
US8458280B2 (en) * 2005-04-08 2013-06-04 Intel-Ne, Inc. Apparatus and method for packet transmission over a high speed network supporting remote direct memory access operations
US8078743B2 (en) * 2006-02-17 2011-12-13 Intel-Ne, Inc. Pipelined processing of RDMA-type network transactions
US20070208820A1 (en) * 2006-02-17 2007-09-06 Neteffect, Inc. Apparatus and method for out-of-order placement and in-order completion reporting of remote direct memory access operations
US8165013B2 (en) * 2006-04-14 2012-04-24 Microsoft Corporation Networked computer with gateway selection
DE102006057686A1 (en) * 2006-12-07 2008-06-12 Robert Bosch Gmbh Procedure for exchanging information
US7738471B2 (en) 2007-09-14 2010-06-15 Harris Corporation High speed packet processing in a wireless network
US8553693B2 (en) * 2010-03-10 2013-10-08 Intel Corporation Network controller circuitry to issue at least one portion of packet payload to device in manner that by-passes communication protocol stack involvement
US8402454B2 (en) * 2010-09-22 2013-03-19 Telefonaktiebolaget L M Ericsson (Publ) In-service software upgrade on cards of virtual partition of network element that includes directing traffic away from cards of virtual partition
EP2718859A1 (en) * 2011-06-08 2014-04-16 Hyperion Core, Inc. Tool-level and hardware-level code optimization and respective hardware modification
US8885562B2 (en) 2012-03-28 2014-11-11 Telefonaktiebolaget L M Ericsson (Publ) Inter-chassis redundancy with coordinated traffic direction
US9614891B1 (en) * 2013-09-23 2017-04-04 Amazon Technologies, Inc. Assembling communications based on captured packets
KR101502146B1 (en) 2013-09-24 2015-03-13 주식회사 케이티 Device for relaying home network signal in access network and method for relaying home network signal in access network using the same
WO2017156549A1 (en) * 2016-03-11 2017-09-14 Purdue Research Foundation Computer remote indirect memory access system
US10264057B2 (en) * 2016-12-08 2019-04-16 Sap Se Hybrid cloud integration systems and methods
CN111726361B (en) * 2020-06-19 2022-02-22 西安微电子技术研究所 Ethernet communication protocol stack system and implementation method

Citations (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4366538A (en) 1980-10-31 1982-12-28 Honeywell Information Systems Inc. Memory controller with queue control apparatus
US4991133A (en) 1988-10-07 1991-02-05 International Business Machines Corp. Specialized communications processor for layered protocols
US5056058A (en) 1989-03-13 1991-10-08 Hitachi, Ltd. Communication protocol for predicting communication frame type in high-speed processing system
US5097442A (en) 1985-06-20 1992-03-17 Texas Instruments Incorporated Programmable depth first-in, first-out memory
US5163131A (en) 1989-09-08 1992-11-10 Auspex Systems, Inc. Parallel i/o network file server architecture
US5212778A (en) 1988-05-27 1993-05-18 Massachusetts Institute Of Technology Message-driven processor in a concurrent computer
US5280477A (en) 1992-08-17 1994-01-18 E-Systems, Inc. Network synchronous data distribution system
US5289580A (en) 1991-05-10 1994-02-22 Unisys Corporation Programmable multiple I/O interface controller
US5303344A (en) 1989-03-13 1994-04-12 Hitachi, Ltd. Protocol processing apparatus for use in interfacing network connected computer systems utilizing separate paths for control information and data transfer
US5412782A (en) 1992-07-02 1995-05-02 3Com Corporation Programmed I/O ethernet adapter with early interrupts for accelerating data transfer
US5448566A (en) 1993-11-15 1995-09-05 International Business Machines Corporation Method and apparatus for facilitating communication in a multilayer communication architecture via a dynamic communication channel
US5485579A (en) 1989-09-08 1996-01-16 Auspex Systems, Inc. Multiple facility operating system architecture
US5506966A (en) 1991-12-17 1996-04-09 Nec Corporation System for message traffic control utilizing prioritized message chaining for queueing control ensuring transmission/reception of high priority messages
US5511169A (en) 1992-03-02 1996-04-23 Mitsubishi Denki Kabushiki Kaisha Data transmission apparatus and a communication path management method therefor
US5548730A (en) 1994-09-20 1996-08-20 Intel Corporation Intelligent bus bridge for input/output subsystems in a computer system
US5566170A (en) 1994-12-29 1996-10-15 Storage Technology Corporation Method and apparatus for accelerated packet forwarding
US5588121A (en) 1993-01-19 1996-12-24 International Computers Limited Parallel computer having MAC-relay layer snooped transport header to determine if a message should be routed directly to transport layer depending on its destination
US5590328A (en) 1991-07-25 1996-12-31 Mitsubishi Denki Kabushiki Kaisha Protocol parallel processing apparatus having a plurality of CPUs allocated to process hierarchical protocols
US5592622A (en) 1995-05-10 1997-01-07 3Com Corporation Network intermediate system with message passing architecture
US5629933A (en) 1995-06-07 1997-05-13 International Business Machines Corporation Method and system for enhanced communication in a multisession packet based communication system
US5634127A (en) 1994-11-30 1997-05-27 International Business Machines Corporation Methods and apparatus for implementing a message driven processor in a client-server environment
US5634099A (en) 1994-12-09 1997-05-27 International Business Machines Corporation Direct memory access unit for transferring data between processor memories in multiprocessing systems
US5642482A (en) 1992-12-22 1997-06-24 Bull, S.A. System for network transmission using a communication co-processor comprising a microprocessor to implement protocol layer and a microprocessor to manage DMA
US5664114A (en) 1995-05-16 1997-09-02 Hewlett-Packard Company Asynchronous FIFO queuing system operating with minimal queue status
US5671355A (en) 1992-06-26 1997-09-23 Predacomm, Inc. Reconfigurable network interface apparatus and method
US5678060A (en) 1993-10-28 1997-10-14 Hitachi, Ltd. System for executing high speed communication protocol processing by predicting protocol header of next frame utilizing successive analysis of protocol header until successful header retrieval
US5692130A (en) 1992-01-14 1997-11-25 Ricoh Company, Ltd. Method for selectively using one or two communication channel by a transmitting data terminal based on data type and channel availability
US5699317A (en) 1992-01-22 1997-12-16 Ramtron International Corporation Enhanced DRAM with all reads from on-chip cache and all writers to memory array
US5701516A (en) 1992-03-09 1997-12-23 Auspex Systems, Inc. High-performance non-volatile RAM protected write cache accelerator system employing DMA and data transferring scheme
US5701434A (en) 1995-03-16 1997-12-23 Hitachi, Ltd. Interleave memory controller with a common access queue
US5749095A (en) 1996-07-01 1998-05-05 Sun Microsystems, Inc. Multiprocessing system configured to perform efficient write operations
WO1998019412A1 (en) 1996-10-31 1998-05-07 Iready Corporation Multiple network protocol encoder/decoder and data processor
US5751715A (en) 1996-08-08 1998-05-12 Gadzoox Microsystems, Inc. Accelerator fiber channel hub and protocol
US5752078A (en) 1995-07-10 1998-05-12 International Business Machines Corporation System for minimizing latency data reception and handling data packet error if detected while transferring data packet from adapter memory to host memory
US5758089A (en) 1995-11-02 1998-05-26 Sun Microsystems, Inc. Method and apparatus for burst transferring ATM packet header and data to a host computer system
US5758194A (en) 1993-11-30 1998-05-26 Intel Corporation Communication apparatus for handling networks with different transmission protocols by stripping or adding data to the data stream in the application layer
US5758084A (en) 1995-02-27 1998-05-26 Hewlett-Packard Company Apparatus for parallel client/server communication having data structures which stored values indicative of connection state and advancing the connection state of established connections
US5758186A (en) 1995-10-06 1998-05-26 Sun Microsystems, Inc. Method and apparatus for generically handling diverse protocol method calls in a client/server computer system
US5771349A (en) 1992-05-12 1998-06-23 Compaq Computer Corp. Network packet switch using shared memory for repeating and bridging packets at media rate
US5790804A (en) 1994-04-12 1998-08-04 Mitsubishi Electric Information Technology Center America, Inc. Computer network interface and network protocol with direct deposit messaging
US5794061A (en) 1995-08-16 1998-08-11 Microunity Systems Engineering, Inc. General purpose, multiple precision parallel operation, programmable media processor
US5802580A (en) 1994-09-01 1998-09-01 Mcalpine; Gary L. High performance digital electronic system architecture and memory circuit thereof
US5809328A (en) 1995-12-21 1998-09-15 Unisys Corp. Apparatus for fibre channel transmission having interface logic, buffer memory, multiplexor/control device, fibre channel controller, gigabit link module, microprocessor, and bus control device
US5812775A (en) 1995-07-12 1998-09-22 3Com Corporation Method and apparatus for internetworking buffer management
US5815646A (en) 1993-04-13 1998-09-29 C-Cube Microsystems Decompression processor for video applications
WO1998050852A1 (en) 1997-05-08 1998-11-12 Iready Corporation Hardware accelerator for an object-oriented programming language
WO1999004343A1 (en) 1997-07-18 1999-01-28 Interprophet Corporation Tcp/ip network accelerator system and method
US5878225A (en) 1996-06-03 1999-03-02 International Business Machines Corporation Dual communication services interface for distributed transaction processing
US5913028A (en) 1995-10-06 1999-06-15 Xpoint Technologies, Inc. Client/server data traffic delivery system and method
US5930830A (en) 1997-01-13 1999-07-27 International Business Machines Corporation System and method for concatenating discontiguous memory pages
US5935205A (en) 1995-06-22 1999-08-10 Hitachi, Ltd. Computer system having a plurality of computers each providing a shared storage access processing mechanism for controlling local/remote access to shared storage devices
US5937169A (en) 1997-10-29 1999-08-10 3Com Corporation Offload of TCP segmentation to a smart adapter
US5941969A (en) 1997-10-22 1999-08-24 Auspex Systems, Inc. Bridge for direct data storage device access
US5941972A (en) 1997-12-31 1999-08-24 Crossroads Systems, Inc. Storage router and method for providing virtual local storage
US5950203A (en) 1997-12-31 1999-09-07 Mercury Computer Systems, Inc. Method and apparatus for high-speed access to and sharing of storage devices on a networked digital data processing system
US5991299A (en) 1997-09-11 1999-11-23 3Com Corporation High speed header translation processing
US5996024A (en) 1998-01-14 1999-11-30 Emc Corporation Method and apparatus for a SCSI applications server which extracts SCSI commands and data from message and encapsulates SCSI responses to provide transparent operation
WO1999065219A1 (en) 1998-06-11 1999-12-16 Iready Corporation Tcp/ip/ppp modem
US6005849A (en) 1997-09-24 1999-12-21 Emulex Corporation Full-duplex communication processor which can be used for fibre channel frames
US6009478A (en) 1997-11-04 1999-12-28 Adaptec, Inc. File array communications interface for communicating between a host computer and an adapter
US6016513A (en) 1998-02-19 2000-01-18 3Com Corporation Method of preventing packet loss during transfers of data packets between a network interface card and an operating system of a computer
US6026452A (en) 1997-02-26 2000-02-15 Pitts; William Michael Network distributed site cache RAM claimed as up/down stream request/reply channel for storing anticipated data and meta data
WO2000013091A1 (en) 1998-08-28 2000-03-09 Alacritech, Inc. Intelligent network interface device and system for accelerating communication
US6038562A (en) * 1996-09-05 2000-03-14 International Business Machines Corporation Interface to support state-dependent web applications accessing a relational database
US6044438A (en) 1997-07-10 2000-03-28 International Business Machiness Corporation Memory controller for controlling memory accesses across networks in distributed shared memory processing systems
US6057863A (en) 1997-10-31 2000-05-02 Compaq Computer Corporation Dual purpose apparatus, method and system for accelerated graphics port and fibre channel arbitrated loop interfaces
US6061368A (en) 1997-11-05 2000-05-09 Xylan Corporation Custom circuitry for adaptive hardware routing engine
US6065096A (en) 1997-09-30 2000-05-16 Lsi Logic Corporation Integrated single chip dual mode raid controller
US6141705A (en) 1998-06-12 2000-10-31 Microsoft Corporation System for querying a peripheral device to determine its processing capabilities and then offloading specific processing tasks from a host to the peripheral device when needed
WO2001004470A1 (en) 1999-07-08 2001-01-18 Smullin Corporation Apparatus and method for multi-conduit waterlift engine silencing
WO2001005107A1 (en) 1999-07-13 2001-01-18 Alteon Web Systems, Inc. Apparatus and method to minimize congestion in an output queuing switch
WO2001005116A2 (en) 1999-07-13 2001-01-18 Alteon Web Systems, Inc. Routing method and apparatus
WO2001005123A1 (en) 1999-07-13 2001-01-18 Alteon Web Systems, Inc. Apparatus and method to minimize incoming data loss
US6226680B1 (en) 1997-10-14 2001-05-01 Alacritech, Inc. Intelligent network interface system method for protocol processing
WO2001040960A1 (en) 1999-11-30 2001-06-07 3Com Corporation Fifo-based network interface supporting out-of-order processing
US6246683B1 (en) 1998-05-01 2001-06-12 3Com Corporation Receive processing with network protocol bypass
US6345301B1 (en) 1999-03-30 2002-02-05 Unisys Corporation Split data path distributed network protocol

Patent Citations (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4366538A (en) 1980-10-31 1982-12-28 Honeywell Information Systems Inc. Memory controller with queue control apparatus
US5097442A (en) 1985-06-20 1992-03-17 Texas Instruments Incorporated Programmable depth first-in, first-out memory
US5212778A (en) 1988-05-27 1993-05-18 Massachusetts Institute Of Technology Message-driven processor in a concurrent computer
US4991133A (en) 1988-10-07 1991-02-05 International Business Machines Corp. Specialized communications processor for layered protocols
US5056058A (en) 1989-03-13 1991-10-08 Hitachi, Ltd. Communication protocol for predicting communication frame type in high-speed processing system
US5303344A (en) 1989-03-13 1994-04-12 Hitachi, Ltd. Protocol processing apparatus for use in interfacing network connected computer systems utilizing separate paths for control information and data transfer
US5485579A (en) 1989-09-08 1996-01-16 Auspex Systems, Inc. Multiple facility operating system architecture
US5163131A (en) 1989-09-08 1992-11-10 Auspex Systems, Inc. Parallel i/o network file server architecture
US5931918A (en) 1989-09-08 1999-08-03 Auspex Systems, Inc. Parallel I/O network file server architecture
US5289580A (en) 1991-05-10 1994-02-22 Unisys Corporation Programmable multiple I/O interface controller
US5590328A (en) 1991-07-25 1996-12-31 Mitsubishi Denki Kabushiki Kaisha Protocol parallel processing apparatus having a plurality of CPUs allocated to process hierarchical protocols
US5506966A (en) 1991-12-17 1996-04-09 Nec Corporation System for message traffic control utilizing prioritized message chaining for queueing control ensuring transmission/reception of high priority messages
US5692130A (en) 1992-01-14 1997-11-25 Ricoh Company, Ltd. Method for selectively using one or two communication channel by a transmitting data terminal based on data type and channel availability
US5699317A (en) 1992-01-22 1997-12-16 Ramtron International Corporation Enhanced DRAM with all reads from on-chip cache and all writers to memory array
US5511169A (en) 1992-03-02 1996-04-23 Mitsubishi Denki Kabushiki Kaisha Data transmission apparatus and a communication path management method therefor
US5701516A (en) 1992-03-09 1997-12-23 Auspex Systems, Inc. High-performance non-volatile RAM protected write cache accelerator system employing DMA and data transferring scheme
US5771349A (en) 1992-05-12 1998-06-23 Compaq Computer Corp. Network packet switch using shared memory for repeating and bridging packets at media rate
US5671355A (en) 1992-06-26 1997-09-23 Predacomm, Inc. Reconfigurable network interface apparatus and method
US5412782A (en) 1992-07-02 1995-05-02 3Com Corporation Programmed I/O ethernet adapter with early interrupts for accelerating data transfer
US5280477A (en) 1992-08-17 1994-01-18 E-Systems, Inc. Network synchronous data distribution system
US5642482A (en) 1992-12-22 1997-06-24 Bull, S.A. System for network transmission using a communication co-processor comprising a microprocessor to implement protocol layer and a microprocessor to manage DMA
US5588121A (en) 1993-01-19 1996-12-24 International Computers Limited Parallel computer having MAC-relay layer snooped transport header to determine if a message should be routed directly to transport layer depending on its destination
US5815646A (en) 1993-04-13 1998-09-29 C-Cube Microsystems Decompression processor for video applications
US5678060A (en) 1993-10-28 1997-10-14 Hitachi, Ltd. System for executing high speed communication protocol processing by predicting protocol header of next frame utilizing successive analysis of protocol header until successful header retrieval
US5448566A (en) 1993-11-15 1995-09-05 International Business Machines Corporation Method and apparatus for facilitating communication in a multilayer communication architecture via a dynamic communication channel
US5758194A (en) 1993-11-30 1998-05-26 Intel Corporation Communication apparatus for handling networks with different transmission protocols by stripping or adding data to the data stream in the application layer
US5790804A (en) 1994-04-12 1998-08-04 Mitsubishi Electric Information Technology Center America, Inc. Computer network interface and network protocol with direct deposit messaging
US5802580A (en) 1994-09-01 1998-09-01 Mcalpine; Gary L. High performance digital electronic system architecture and memory circuit thereof
US5548730A (en) 1994-09-20 1996-08-20 Intel Corporation Intelligent bus bridge for input/output subsystems in a computer system
US5634127A (en) 1994-11-30 1997-05-27 International Business Machines Corporation Methods and apparatus for implementing a message driven processor in a client-server environment
US5634099A (en) 1994-12-09 1997-05-27 International Business Machines Corporation Direct memory access unit for transferring data between processor memories in multiprocessing systems
US5566170A (en) 1994-12-29 1996-10-15 Storage Technology Corporation Method and apparatus for accelerated packet forwarding
US5758084A (en) 1995-02-27 1998-05-26 Hewlett-Packard Company Apparatus for parallel client/server communication having data structures which stored values indicative of connection state and advancing the connection state of established connections
US5701434A (en) 1995-03-16 1997-12-23 Hitachi, Ltd. Interleave memory controller with a common access queue
US5592622A (en) 1995-05-10 1997-01-07 3Com Corporation Network intermediate system with message passing architecture
US5664114A (en) 1995-05-16 1997-09-02 Hewlett-Packard Company Asynchronous FIFO queuing system operating with minimal queue status
US5629933A (en) 1995-06-07 1997-05-13 International Business Machines Corporation Method and system for enhanced communication in a multisession packet based communication system
US5935205A (en) 1995-06-22 1999-08-10 Hitachi, Ltd. Computer system having a plurality of computers each providing a shared storage access processing mechanism for controlling local/remote access to shared storage devices
US5752078A (en) 1995-07-10 1998-05-12 International Business Machines Corporation System for minimizing latency data reception and handling data packet error if detected while transferring data packet from adapter memory to host memory
US5812775A (en) 1995-07-12 1998-09-22 3Com Corporation Method and apparatus for internetworking buffer management
US5794061A (en) 1995-08-16 1998-08-11 Microunity Systems Engineering, Inc. General purpose, multiple precision parallel operation, programmable media processor
US5758186A (en) 1995-10-06 1998-05-26 Sun Microsystems, Inc. Method and apparatus for generically handling diverse protocol method calls in a client/server computer system
US5913028A (en) 1995-10-06 1999-06-15 Xpoint Technologies, Inc. Client/server data traffic delivery system and method
US5758089A (en) 1995-11-02 1998-05-26 Sun Microsystems, Inc. Method and apparatus for burst transferring ATM packet header and data to a host computer system
US5809328A (en) 1995-12-21 1998-09-15 Unisys Corp. Apparatus for fibre channel transmission having interface logic, buffer memory, multiplexor/control device, fibre channel controller, gigabit link module, microprocessor, and bus control device
US5878225A (en) 1996-06-03 1999-03-02 International Business Machines Corporation Dual communication services interface for distributed transaction processing
US5749095A (en) 1996-07-01 1998-05-05 Sun Microsystems, Inc. Multiprocessing system configured to perform efficient write operations
US5751715A (en) 1996-08-08 1998-05-12 Gadzoox Microsystems, Inc. Accelerator fiber channel hub and protocol
US6038562A (en) * 1996-09-05 2000-03-14 International Business Machines Corporation Interface to support state-dependent web applications accessing a relational database
WO1998019412A1 (en) 1996-10-31 1998-05-07 Iready Corporation Multiple network protocol encoder/decoder and data processor
US6034963A (en) 1996-10-31 2000-03-07 Iready Corporation Multiple network protocol encoder/decoder and data processor
US5930830A (en) 1997-01-13 1999-07-27 International Business Machines Corporation System and method for concatenating discontiguous memory pages
US6026452A (en) 1997-02-26 2000-02-15 Pitts; William Michael Network distributed site cache RAM claimed as up/down stream request/reply channel for storing anticipated data and meta data
WO1998050852A1 (en) 1997-05-08 1998-11-12 Iready Corporation Hardware accelerator for an object-oriented programming language
US6044438A (en) 1997-07-10 2000-03-28 International Business Machiness Corporation Memory controller for controlling memory accesses across networks in distributed shared memory processing systems
WO1999004343A1 (en) 1997-07-18 1999-01-28 Interprophet Corporation Tcp/ip network accelerator system and method
US5991299A (en) 1997-09-11 1999-11-23 3Com Corporation High speed header translation processing
US6005849A (en) 1997-09-24 1999-12-21 Emulex Corporation Full-duplex communication processor which can be used for fibre channel frames
US6065096A (en) 1997-09-30 2000-05-16 Lsi Logic Corporation Integrated single chip dual mode raid controller
US6226680B1 (en) 1997-10-14 2001-05-01 Alacritech, Inc. Intelligent network interface system method for protocol processing
US6247060B1 (en) 1997-10-14 2001-06-12 Alacritech, Inc. Passing a communication control block from host to a local device such that a message is processed on the device
US5941969A (en) 1997-10-22 1999-08-24 Auspex Systems, Inc. Bridge for direct data storage device access
US5937169A (en) 1997-10-29 1999-08-10 3Com Corporation Offload of TCP segmentation to a smart adapter
US6057863A (en) 1997-10-31 2000-05-02 Compaq Computer Corporation Dual purpose apparatus, method and system for accelerated graphics port and fibre channel arbitrated loop interfaces
US6009478A (en) 1997-11-04 1999-12-28 Adaptec, Inc. File array communications interface for communicating between a host computer and an adapter
US6061368A (en) 1997-11-05 2000-05-09 Xylan Corporation Custom circuitry for adaptive hardware routing engine
US5941972A (en) 1997-12-31 1999-08-24 Crossroads Systems, Inc. Storage router and method for providing virtual local storage
US5950203A (en) 1997-12-31 1999-09-07 Mercury Computer Systems, Inc. Method and apparatus for high-speed access to and sharing of storage devices on a networked digital data processing system
US5996024A (en) 1998-01-14 1999-11-30 Emc Corporation Method and apparatus for a SCSI applications server which extracts SCSI commands and data from message and encapsulates SCSI responses to provide transparent operation
US6016513A (en) 1998-02-19 2000-01-18 3Com Corporation Method of preventing packet loss during transfers of data packets between a network interface card and an operating system of a computer
US6246683B1 (en) 1998-05-01 2001-06-12 3Com Corporation Receive processing with network protocol bypass
WO1999065219A1 (en) 1998-06-11 1999-12-16 Iready Corporation Tcp/ip/ppp modem
US6141705A (en) 1998-06-12 2000-10-31 Microsoft Corporation System for querying a peripheral device to determine its processing capabilities and then offloading specific processing tasks from a host to the peripheral device when needed
WO2000013091A1 (en) 1998-08-28 2000-03-09 Alacritech, Inc. Intelligent network interface device and system for accelerating communication
US6345301B1 (en) 1999-03-30 2002-02-05 Unisys Corporation Split data path distributed network protocol
WO2001004470A1 (en) 1999-07-08 2001-01-18 Smullin Corporation Apparatus and method for multi-conduit waterlift engine silencing
WO2001005107A1 (en) 1999-07-13 2001-01-18 Alteon Web Systems, Inc. Apparatus and method to minimize congestion in an output queuing switch
WO2001005123A1 (en) 1999-07-13 2001-01-18 Alteon Web Systems, Inc. Apparatus and method to minimize incoming data loss
WO2001005116A2 (en) 1999-07-13 2001-01-18 Alteon Web Systems, Inc. Routing method and apparatus
WO2001040960A1 (en) 1999-11-30 2001-06-07 3Com Corporation Fifo-based network interface supporting out-of-order processing

Non-Patent Citations (50)

* Cited by examiner, † Cited by third party
Title
"Comparison of Novell Netware and TCP/IP Protocol Architectures", by J.S. Carbone, 19 pages, printed Apr. 10, 1998.
"File System Design For An NFS File Server Appliance", Articel by D. Hitz, et al., 13 pages, Jan. 1, 1996.
"Toshiba Delivers First Chip to Make Consumer Devices Internet-Ready Based On iReady's Design," Press Release Oct., 1998, 3 pages, printed Nov. 28, 1998.
"Two-Way TCP Traffic Over Rate Controlled Channels: Effects and Analysis", by Kalampoukas et al., IEEE Transactions on Networking, vol. 6, No. 6, Dec. 1998.
Adaptec articel entited "EtherStorage Frequently Asked Questions", 5 pages, printed Jul. 19, 2000.
Adaptec article entited "EtherStorage White Paper", 7 pages, printed Jul. 19, 2000.
Adaptec article entitled "AEA-7110C-a DuraSAN product", 11 pages, printed Oct. 1, 2001.
Adaptec Press Release article entitled "Adaptec Announces EtherStorage Technology", 2 pages, May 4, 2000, printed Jun. 14, 2000.
Andrew S. Tanenbaum, Computer Networks, Third Edition, 1996, ISBN 0-13-349945-6.
CBS Market Watch article entitled "Montreal Start-Up Battles Data Storage Bottleneck", by S. Taylor, dated Mar. 5, 2000, 2 pages, printed Mar. 7, 2000.
CIBC World Markets article entitled "Computers; Storage", by J. Berlino et al., 9 pages, dated Aug. 7, 2000.
EETimes article entitled "Tuner for Toshiba, Toshiba Taps iReady for Internet Tuner", by David Lammers, 2 pages, printed Nov. 2, 1998.
EETimes article entitled Enterprise System Uses Flexible Spec, dated Aug. 10, 1998, printed Nov. 25, 1998.
Form 10-K for Exelan, Inc., for the fiscal year ending Dec. 31, 1987 (10 pages).
Form 10-K for Exelan, Inc., for the fiscal year ending Dec. 31, 1988 (10 pages).
Gigabit Ethernet Technical Brief, Achieving End-to-End Performance. Alteon Networks, Inc., First Edition, Sep. 1996.
Internet pages directed to Technical Brief on Alteon Ethernet Gigabit NIC technology, www.alteon.com, 14 pages, printed Mar. 15, 1997.
Internet pages entitled "DART: Fast Application Level Networking via Data-Copy Avoidance," by Robert J. Walsh, printed Jun. 3, 1999.
Internet pages entitled "Hardware Assisted Protocol Processing", (which Eugene Feinber is working on), 1 page, printed Nov. 25, 1998.
Internet pages entitled "Hardware Assisted Protocol Processing", which Eugene Feinberg is working on, printed Nov. 25, 1998.
Internet pages entitled "Smart Ethernet Network interface Cards", which Berend Ozceri is developing, printed Nov. 25, 1998.
Internet pages entitled iReady Products, printed Nov. 25, 1998.
Internet pages entitled Technical White Paper-Xpoint's Disk to LAN Acceleration Solution for Windows NT Server, printed Jun. 5, 1997.
Internet pages entitled: A Guide to the Paragon XP/S-A7 Supercomputer at Indiana University. 13 pages, printed Dec. 21, 1998.
Internet pages entitled: Asante and 100BASE-T Fast Ethernet. 7 pages, printed May 27, 1997.
Internet pages entitled: Northridge/Southbridge vs. Intel Hub Architecture, 4 pages, printed Feb. 19, 2001.
Internet pages from iReady Products, web sitehttp://www.ireadyco.com/products,html, 2 pages, downloaded Nov. 25, 1998.
Internet pages of InterProphet entitled "Frequently Asked Questions", by Lynn Jolitz, printed Jun. 14, 2000.
Internet pages of Xaqti corporation entitled "GigaPower Protocol Processor Product Review," printed Nov. 25, 1999.
Internet pages Xpoint Technologies, Inc. entitled "Smart LAN Work Requests", 5 pages, printed Dec. 19, 1997.
Internet-draft article entitled "SCSI/TCP (SCSI over TCP)", by J. Satran et al., 38 pages, Feb. 2000, printed May 19, 2000.
Interprophet article entitled "Technology" http://www.interprophet.com/technology.html, 17 pages, printed Mar. 1, 2000.
iReady article entitled "About Us Introduction", Internet pages fromhttp://www.iReadyco.com/about.html, 3 pages, printed Nov. 25, 1998.
iReady Corporation, article entitled "The I-1000 Internet Tuner", 2 pages, date unknown.
iReady News Archive article entitled "Revolutionary Approach to Consumer Electronics Internet Connectivity Funded", San Jose, CA, Nov. 20, 1997. 2 pages, printed Nov. 2, 1998.
iReady News Archive article entitled "Seiko Instruments Inc. (SII) Introduces World's First Internet-Ready Intelligent LCD Modules Based on Ready Technology," Santa Clara, CA and Chiba, Japan, Oct. 26, 1998. 2 pages, printed Nov. 2, 1998.
iReady News Archives article entitled "iReady Rounding Out ManagementTeam with Two Key Executives", http://www.ireadyco.com/archives/keyexec.html, 2 pages, printed Nov. 28, 1998.
iReady News Archives, Toshiba, iReady shipping Internet chip, 1 page, printed Nov. 25, 1998.
IReady News article entitled "Toshiba Delivers First Class Chips to Make Consumer Devices Internet-Ready Based on iReady Design", Santa Clara, CA, and Tokyo, Japan, Oct. 14, 1998, printed Nov. 2, 1998.
iSCSI HBA articel entitled "FCE-3210/6410 32 and 64-bit PCI-to-fibre Channel HBA", 6 pages, printed Oct. 1, 2001.
iSCSI HBA article entitled "iSCSI and 2Gigabit fibre Channel Host Bus Adapters from Emulex, QLogic, Adaptec, JNI", 8 pages, printed Oct. 1, 2001.
ISCSI.com article entitled "iSCSI Storage", 2 pages, printed Oct. 1, 2001.
Jato Technologies article entitled Network Accelerator Chip Architecture, twelve-sled presentation, printed Aug. 19, 1998.
Merrill Lynch article entitled "Storage Futures", by S. Milunovich, 22 pages, dated May 10, 2000.
NEWSwatch article entitled "iReady internet Tuner to Web Enable Devices", Tuesday, Nov. 5, 1996, printed Nov. 2, 1998.
Richard Stevens, "TCP/IP Illustrated, vol. 1, The Protocols", pp. 325-326 (1994).
U.S. patent application No. 08/964,304, by Napolitano, et al., entitled "File Array Storage Architecture", filed Nov. 4, 1997.
U.S. patent application Ser. No. 60/053,240, Jolitz et al, filed Jul. 18, 1997.
VIA Technologies, Inc. article entitled "VT8501 Apollo MVP4", pp. i-vi, 1-11, cover and copyright pales, revision 1.3, Feb. 1, 2000.
Zilog product Brief entitled "Z85C30 CMOS SCC Serial Communication Controller", Zilog Inc., 3 pages, 1997.

Cited By (341)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050071490A1 (en) * 1987-01-12 2005-03-31 Craft Peter K. Method to synchronize and upload an offloaded network stack connection with a network stack
US9098297B2 (en) 1997-05-08 2015-08-04 Nvidia Corporation Hardware accelerator for an object-oriented programming language
US20060031818A1 (en) * 1997-05-08 2006-02-09 Poff Thomas C Hardware accelerator for an object-oriented programming language
US20060075130A1 (en) * 1997-10-14 2006-04-06 Craft Peter K Protocol stack that offloads a TCP connection from a host computer to a network interface device
US7673072B2 (en) 1997-10-14 2010-03-02 Alacritech, Inc. Fast-path apparatus for transmitting data corresponding to a TCP connection
US7809847B2 (en) 1997-10-14 2010-10-05 Alacritech, Inc. Network interface device that can transfer control of a TCP connection to a host CPU
US7844743B2 (en) 1997-10-14 2010-11-30 Alacritech, Inc. Protocol stack that offloads a TCP connection from a host computer to a network interface device
US7853723B2 (en) 1997-10-14 2010-12-14 Alacritech, Inc. TCP/IP offload network interface device
US7945699B2 (en) 1997-10-14 2011-05-17 Alacritech, Inc. Obtaining a destination address so that a network interface device can write network data without headers directly into host memory
US8131880B2 (en) 1997-10-14 2012-03-06 Alacritech, Inc. Intelligent network interface device and system for accelerated communication
US7694024B2 (en) 1997-10-14 2010-04-06 Alacritech, Inc. TCP/IP offload device with fast-path TCP ACK generating and transmitting mechanism
US8447803B2 (en) 1997-10-14 2013-05-21 Alacritech, Inc. Method and apparatus for distributing network traffic processing on a multiprocessor computer
US20070118665A1 (en) * 1997-10-14 2007-05-24 Philbrick Clive M TCP/IP offload device with fast-path TCP ACK generating and transmitting mechanism
US8539112B2 (en) 1997-10-14 2013-09-17 Alacritech, Inc. TCP/IP offload device
US8631140B2 (en) 1997-10-14 2014-01-14 Alacritech, Inc. Intelligent network interface system and method for accelerated protocol processing
US8782199B2 (en) 1997-10-14 2014-07-15 A-Tech Llc Parsing a packet header
US8805948B2 (en) 1997-10-14 2014-08-12 A-Tech Llc Intelligent network interface system and method for protocol processing
US8856379B2 (en) 1997-10-14 2014-10-07 A-Tech Llc Intelligent network interface system and method for protocol processing
US20050160139A1 (en) * 1997-10-14 2005-07-21 Boucher Laurence B. Network interface device that can transfer control of a TCP connection to a host CPU
US9009223B2 (en) 1997-10-14 2015-04-14 Alacritech, Inc. Method and apparatus for processing received network packets on a network interface for a computer
US20050198198A1 (en) * 1997-10-14 2005-09-08 Craft Peter K. Protocol stack that offloads a TCP connection from a host computer to a network interface device
US7664868B2 (en) 1998-04-27 2010-02-16 Alacritech, Inc. TCP/IP offload network interface device
US20040213290A1 (en) * 1998-06-11 2004-10-28 Johnson Michael Ward TCP/IP/PPP modem
US7996568B2 (en) 1998-06-11 2011-08-09 Nvidia Corporation System, method, and computer program product for an offload engine with DMA capabilities
US7483375B2 (en) 1998-06-11 2009-01-27 Nvidia Corporation TCP/IP/PPP modem
US7664883B2 (en) 1998-08-28 2010-02-16 Alacritech, Inc. Network interface device that fast-path processes solicited session layer read commands
US7062574B1 (en) * 1999-07-01 2006-06-13 Agere Systems Inc. System and method for selectively detaching point-to-point protocol header information
US8135842B1 (en) 1999-08-16 2012-03-13 Nvidia Corporation Internet jack
US8180897B2 (en) 1999-10-14 2012-05-15 Bluearc Uk Limited Apparatus and method for hardware implementation or acceleration of operating system functions
US20030222216A1 (en) * 2000-03-22 2003-12-04 Walkenstein Jonathan A. Low light imaging device
US9436542B2 (en) 2000-04-17 2016-09-06 Circadence Corporation Automated network infrastructure test and diagnostic system and method therefor
US20110238860A1 (en) * 2000-04-17 2011-09-29 Mark Vange System and method for implementing application functionality within a network infrastructure
US9380129B2 (en) 2000-04-17 2016-06-28 Circadence Corporation Data redirection system and method therefor
US20090182868A1 (en) * 2000-04-17 2009-07-16 Mcfate Marlin Popeye Automated network infrastructure test and diagnostic system and method therefor
US8977712B2 (en) 2000-04-17 2015-03-10 Circadence Corporation System and method for implementing application functionality within a network infrastructure including a wireless communication link
US9578124B2 (en) 2000-04-17 2017-02-21 Circadence Corporation Optimization of enhanced network links
US8510468B2 (en) 2000-04-17 2013-08-13 Ciradence Corporation Route aware network link acceleration
US8463935B2 (en) 2000-04-17 2013-06-11 Circadence Corporation Data prioritization system and method therefor
US20090187669A1 (en) * 2000-04-17 2009-07-23 Randy Thornton System and method for reducing traffic and congestion on distributed interactive simulation networks
US9723105B2 (en) 2000-04-17 2017-08-01 Circadence Corporation System and method for implementing application functionality within a network infrastructure
US8417770B2 (en) 2000-04-17 2013-04-09 Circadence Corporation Data redirection system and method therefor
US8386641B2 (en) 2000-04-17 2013-02-26 Circadence Corporation System and method for implementing application functionality within a network infrastructure
US8195823B2 (en) 2000-04-17 2012-06-05 Circadence Corporation Dynamic network link acceleration
US9185185B2 (en) 2000-04-17 2015-11-10 Circadence Corporation System and method for implementing application functionality within a network infrastructure
US20060129697A1 (en) * 2000-04-17 2006-06-15 Mark Vange System and method for implementing application functionality within a network infrastructure
US9148293B2 (en) 2000-04-17 2015-09-29 Circadence Corporation Automated network infrastructure test and diagnostic system and method therefor
US8898340B2 (en) 2000-04-17 2014-11-25 Circadence Corporation Dynamic network link acceleration for network including wireless communication devices
US9923987B2 (en) 2000-04-17 2018-03-20 Circadence Corporation Optimization of enhanced network links
US8065399B2 (en) 2000-04-17 2011-11-22 Circadence Corporation Automated network infrastructure test and diagnostic system and method therefor
USRE45009E1 (en) 2000-04-17 2014-07-08 Circadence Corporation Dynamic network link acceleration
US8024481B2 (en) 2000-04-17 2011-09-20 Circadence Corporation System and method for reducing traffic and congestion on distributed interactive simulation networks
US20100011116A1 (en) * 2000-04-17 2010-01-14 Randy Thornton Dynamic network link acceleration
US8996705B2 (en) 2000-04-17 2015-03-31 Circadence Corporation Optimization of enhanced network links
US7975066B2 (en) 2000-04-17 2011-07-05 Circadence Corporation System and method for implementing application functionality within a network infrastructure
US7962654B2 (en) 2000-04-17 2011-06-14 Circadence Corporation System and method for implementing application functionality within a network infrastructure
US10033840B2 (en) 2000-04-17 2018-07-24 Circadence Corporation System and devices facilitating dynamic network link acceleration
US10154115B2 (en) 2000-04-17 2018-12-11 Circadence Corporation System and method for implementing application functionality within a network infrastructure
US10205795B2 (en) 2000-04-17 2019-02-12 Circadence Corporation Optimization of enhanced network links
US10329410B2 (en) 2000-04-17 2019-06-25 Circadence Corporation System and devices facilitating dynamic network link acceleration
US20100157998A1 (en) * 2000-04-17 2010-06-24 Mark Vange System and method for implementing application functionality within a network infrastructure
US10516751B2 (en) 2000-04-17 2019-12-24 Circadence Corporation Optimization of enhanced network links
US10819826B2 (en) 2000-04-17 2020-10-27 Circadence Corporation System and method for implementing application functionality within a network infrastructure
US10858503B2 (en) 2000-04-17 2020-12-08 Circadence Corporation System and devices facilitating dynamic network link acceleration
US10931775B2 (en) 2000-04-17 2021-02-23 Circadence Corporation Optimization of enhanced network links
US8977711B2 (en) 2000-04-17 2015-03-10 Circadence Corporation System and method for implementing application functionality within a network infrastructure including wirelessly coupled devices
US7269666B1 (en) * 2000-06-30 2007-09-11 Intel Corporation Memory utilization in a network interface
US8019901B2 (en) 2000-09-29 2011-09-13 Alacritech, Inc. Intelligent network storage interface system
US8621101B1 (en) 2000-09-29 2013-12-31 Alacritech, Inc. Intelligent network storage interface device
US20050271042A1 (en) * 2000-11-10 2005-12-08 Michael Johnson Internet modem streaming socket method
US7302499B2 (en) 2000-11-10 2007-11-27 Nvidia Corporation Internet modem streaming socket method
US9030937B2 (en) 2000-11-17 2015-05-12 Foundry Networks, Llc Backplane interface adapter with error control and redundant fabric
US8514716B2 (en) 2000-11-17 2013-08-20 Foundry Networks, Llc Backplane interface adapter with error control and redundant fabric
US8619781B2 (en) 2000-11-17 2013-12-31 Foundry Networks, Llc Backplane interface adapter with error control and redundant fabric
US8964754B2 (en) 2000-11-17 2015-02-24 Foundry Networks, Llc Backplane interface adapter with error control and redundant fabric
US7948872B2 (en) 2000-11-17 2011-05-24 Foundry Networks, Llc Backplane interface adapter with error control and redundant fabric
US7995580B2 (en) 2000-11-17 2011-08-09 Foundry Networks, Inc. Backplane interface adapter with error control and redundant fabric
US7978702B2 (en) 2000-11-17 2011-07-12 Foundry Networks, Llc Backplane interface adapter
US7418522B2 (en) 2000-12-21 2008-08-26 Noatak Software Llc Method and system for communicating an information packet through multiple networks
US20020120761A1 (en) * 2000-12-21 2002-08-29 Berg Mitchell T. Method and system for executing protocol stack instructions to form a packet for causing a computing device to perform an operation
US7640298B2 (en) 2000-12-21 2009-12-29 Berg Mitchell T Method and system for communicating an information packet through multiple router devices
US20020116475A1 (en) * 2000-12-21 2002-08-22 Berg Mitchell T. Method and system for communicating a request packet in response to a state
US7421505B2 (en) 2000-12-21 2008-09-02 Noatak Software Llc Method and system for executing protocol stack instructions to form a packet for causing a computing device to perform an operation
US20020112085A1 (en) * 2000-12-21 2002-08-15 Berg Mitchell T. Method and system for communicating an information packet through multiple networks
US20070061417A1 (en) * 2000-12-21 2007-03-15 Berg Mitchell T Method and system for selectively initiating execution of a software object
US9100409B2 (en) 2000-12-21 2015-08-04 Noatak Software Llc Method and system for selecting a computing device for maintaining a client session in response to a request packet
US7649876B2 (en) 2000-12-21 2010-01-19 Berg Mitchell T Method and system for communicating an information packet through multiple router devices
US7287090B1 (en) 2000-12-21 2007-10-23 Noatak Software, Llc Method and system for identifying a computing device in response to a request packet
US7546369B2 (en) 2000-12-21 2009-06-09 Berg Mitchell T Method and system for communicating a request packet in response to a state
US7406538B2 (en) 2000-12-21 2008-07-29 Noatak Software Llc Method and system for identifying a computing device in response to an information packet
US20020112087A1 (en) * 2000-12-21 2002-08-15 Berg Mitchell T. Method and system for establishing a data structure of a connection with a client
US20070061437A1 (en) * 2000-12-21 2007-03-15 Berg Mitchell T Method and system for identifying a computing device in response to an information packet
US7512686B2 (en) * 2000-12-21 2009-03-31 Berg Mitchell T Method and system for establishing a data structure of a connection with a client
US7506063B2 (en) 2000-12-21 2009-03-17 Noatak Software Llc Method and system for initiating execution of software in response to a state
US20070061418A1 (en) * 2000-12-21 2007-03-15 Berg Mitchell T Method and system for initiating execution of software in response to a state
US8341290B2 (en) 2000-12-21 2012-12-25 Noatak Software Llc Method and system for selecting a computing device for maintaining a client session in response to a request packet
US8073002B2 (en) 2001-01-26 2011-12-06 Nvidia Corporation System, method, and computer program product for multi-mode network interface operation
US8059680B2 (en) 2001-01-26 2011-11-15 Nvidia Corporation Offload system, method, and computer program product for processing network communications associated with a plurality of ports
US20070064724A1 (en) * 2001-01-26 2007-03-22 Minami John S Offload system, method, and computer program product for processing network communications associated with a plurality of ports
US20070064725A1 (en) * 2001-01-26 2007-03-22 Minami John S System, method, and computer program product for multi-mode network interface operation
US7260668B2 (en) * 2001-02-14 2007-08-21 Micronas Gmbh Network co-processor for vehicles
US20020120888A1 (en) * 2001-02-14 2002-08-29 Jorg Franke Network co-processor for vehicles
US20090097499A1 (en) * 2001-04-11 2009-04-16 Chelsio Communications, Inc. Multi-purpose switching network interface controller
US8032655B2 (en) 2001-04-11 2011-10-04 Chelsio Communications, Inc. Configurable switching network interface controller using forwarding engine
US20040172485A1 (en) * 2001-04-11 2004-09-02 Kianoosh Naghshineh Multi-purpose switching network interface controller
US7447795B2 (en) 2001-04-11 2008-11-04 Chelsio Communications, Inc. Multi-purpose switching network interface controller
US8218555B2 (en) 2001-04-24 2012-07-10 Nvidia Corporation Gigabit ethernet adapter
US20030165160A1 (en) * 2001-04-24 2003-09-04 Minami John Shigeto Gigabit Ethernet adapter
US20030009651A1 (en) * 2001-05-15 2003-01-09 Zahid Najam Apparatus and method for interconnecting a processor to co-processors using shared memory
US7210022B2 (en) * 2001-05-15 2007-04-24 Cloudshield Technologies, Inc. Apparatus and method for interconnecting a processor to co-processors using a shared memory as the communication interface
US20030031172A1 (en) * 2001-05-31 2003-02-13 Ron Grinfeld TCP receiver acceleration
US7142539B2 (en) * 2001-05-31 2006-11-28 Broadcom Corporation TCP receiver acceleration
US7856020B2 (en) * 2001-05-31 2010-12-21 Broadcom Corp. TCP receiver acceleration
US20070086454A1 (en) * 2001-05-31 2007-04-19 Ron Grinfeld TCP Receiver Acceleration
US20040062267A1 (en) * 2002-03-06 2004-04-01 Minami John Shigeto Gigabit Ethernet adapter supporting the iSCSI and IPSEC protocols
US20030169744A1 (en) * 2002-03-07 2003-09-11 Uri Elzur Receiver-aided set-up request routing
US7305007B2 (en) * 2002-03-07 2007-12-04 Broadcom Corporation Receiver-aided set-up request routing
US6944670B2 (en) * 2002-03-13 2005-09-13 Commatch Ltd. Method and apparatus for multiple processing of a plurality of communication protocols on a single processing machine
US20030223433A1 (en) * 2002-04-08 2003-12-04 Jung-Tae Lee Internet protocol system using hardware protocol processing logic and parallel data processing method using the same
US9055104B2 (en) 2002-04-22 2015-06-09 Alacritech, Inc. Freeing transmit memory on a network interface device prior to receiving an acknowledgment that transmit data has been received by a remote device
US20070253430A1 (en) * 2002-04-23 2007-11-01 Minami John S Gigabit Ethernet Adapter
US20030204631A1 (en) * 2002-04-30 2003-10-30 Microsoft Corporation Method to synchronize and upload an offloaded network stack connection with a network stack
US7181531B2 (en) * 2002-04-30 2007-02-20 Microsoft Corporation Method to synchronize and upload an offloaded network stack connection with a network stack
US7830884B2 (en) 2002-05-06 2010-11-09 Foundry Networks, Llc Flexible method for processing data packets in a network routing system for enhanced efficiency and monitoring capability
US8671219B2 (en) 2002-05-06 2014-03-11 Foundry Networks, Llc Method and apparatus for efficiently processing data packets in a computer network
US8989202B2 (en) 2002-05-06 2015-03-24 Foundry Networks, Llc Pipeline method and system for switching packets
US8170044B2 (en) 2002-05-06 2012-05-01 Foundry Networks, Llc Pipeline method and system for switching packets
US8194666B2 (en) 2002-05-06 2012-06-05 Foundry Networks, Llc Flexible method for processing data packets in a network routing system for enhanced efficiency and monitoring capability
US7813367B2 (en) * 2002-05-06 2010-10-12 Foundry Networks, Inc. Pipeline method and system for switching packets
US10909623B2 (en) 2002-05-21 2021-02-02 Ip Reservoir, Llc Method and apparatus for processing financial information at hardware speeds using FPGA devices
US7515612B1 (en) 2002-07-19 2009-04-07 Qlogic, Corporation Method and system for processing network data packets
US7403542B1 (en) 2002-07-19 2008-07-22 Qlogic, Corporation Method and system for processing network data packets
US7213045B2 (en) * 2002-08-16 2007-05-01 Silverback Systems Inc. Apparatus and method for transmit transport protocol termination
US20040064815A1 (en) * 2002-08-16 2004-04-01 Silverback Systems, Inc. Apparatus and method for transmit transport protocol termination
US7480312B2 (en) 2002-08-19 2009-01-20 Tehuti Networks Ltd. Network traffic accelerator system and method
US20040042487A1 (en) * 2002-08-19 2004-03-04 Tehuti Networks Inc. Network traffic accelerator system and method
US8230090B2 (en) * 2002-09-11 2012-07-24 Broadcom Corporation System and method for TCP offloading and uploading
US20040049591A1 (en) * 2002-09-11 2004-03-11 Fan Kan Frankie System and method for TCP offloading and uploading
US7729288B1 (en) 2002-09-11 2010-06-01 Qlogic, Corporation Zone management in a multi-module fibre channel switch
US9542310B2 (en) 2002-11-01 2017-01-10 Hitachi Data Systems Engineering UK Limited File server node with non-volatile memory processing module coupled to cluster file server node
US8041735B1 (en) 2002-11-01 2011-10-18 Bluearc Uk Limited Distributed file system and method
US8639731B2 (en) 2002-11-01 2014-01-28 Hitachi Data Engineering UK Limited Apparatus for managing plural versions of a root node for an object of a file system
US9753848B2 (en) 2002-11-01 2017-09-05 Hitachi Data Systems Engineering UK Limited Apparatus for managing a plurality of root nodes for file systems
US8224877B2 (en) 2002-11-01 2012-07-17 Bluearc Uk Limited Apparatus and method for hardware-based file system
US8788530B2 (en) 2002-11-01 2014-07-22 Hitachi Data Systems Engineering UK Limited Distributed file system and method
US7362772B1 (en) 2002-12-13 2008-04-22 Nvidia Corporation Network processing pipeline chipset for routing and host packet processing
US7324547B1 (en) 2002-12-13 2008-01-29 Nvidia Corporation Internet protocol (IP) router residing in a processor chipset
US7924868B1 (en) 2002-12-13 2011-04-12 Nvidia Corporation Internet protocol (IP) router residing in a processor chipset
US20090073884A1 (en) * 2003-02-14 2009-03-19 Istor Networks, Inc. Network receive interface for high bandwidth hardware-accelerated packet processing
US7389462B1 (en) 2003-02-14 2008-06-17 Istor Networks, Inc. System and methods for high rate hardware-accelerated network protocol processing
US7594002B1 (en) 2003-02-14 2009-09-22 Istor Networks, Inc. Hardware-accelerated high availability integrated networked storage system
US7869355B2 (en) 2003-02-14 2011-01-11 Promise Technology, Inc. Network receive interface for high bandwidth hardware-accelerated packet processing
US7962825B2 (en) 2003-02-14 2011-06-14 Promise Technology, Inc. System and methods for high rate hardware-accelerated network protocol processing
US20090063696A1 (en) * 2003-02-14 2009-03-05 Istor Networks, Inc. System and methods for high rate hardware-accelerated network protocol processing
US7460473B1 (en) 2003-02-14 2008-12-02 Istor Networks, Inc. Network receive interface for high bandwidth hardware-accelerated packet processing
US8099470B2 (en) 2003-02-18 2012-01-17 Promise Technology, Inc. Remote direct memory access for iSCSI
US20090248830A1 (en) * 2003-02-18 2009-10-01 Istor Networks, Inc. REMOTE DIRECT MEMORY ACCESS FOR iSCSI
US7512663B1 (en) 2003-02-18 2009-03-31 Istor Networks, Inc. Systems and methods of directly placing data in an iSCSI storage device
US8718051B2 (en) 2003-05-15 2014-05-06 Foundry Networks, Llc System and method for high speed packet transmission
US9461940B2 (en) 2003-05-15 2016-10-04 Foundry Networks, Llc System and method for high speed packet transmission
US8811390B2 (en) 2003-05-15 2014-08-19 Foundry Networks, Llc System and method for high speed packet transmission
US7613109B2 (en) 2003-06-05 2009-11-03 Nvidia Corporation Processing data for a TCP connection using an offload unit
US7363572B2 (en) 2003-06-05 2008-04-22 Nvidia Corporation Editing outbound TCP frames and generating acknowledgements
US7420931B2 (en) 2003-06-05 2008-09-02 Nvidia Corporation Using TCP/IP offload to accelerate packet filtering
US7412488B2 (en) 2003-06-05 2008-08-12 Nvidia Corporation Setting up a delegated TCP connection for hardware-optimized processing
US7609696B2 (en) 2003-06-05 2009-10-27 Nvidia Corporation Storing and accessing TCP connection information
US20040258075A1 (en) * 2003-06-05 2004-12-23 Sidenblad Paul J. Editing outbound TCP frames and generating acknowledgements
US20040249881A1 (en) * 2003-06-05 2004-12-09 Jha Ashutosh K. Transmitting commands and information between a TCP/IP stack and an offload unit
US8417852B2 (en) 2003-06-05 2013-04-09 Nvidia Corporation Uploading TCP frame data to user buffers and buffers in system memory
US7991918B2 (en) 2003-06-05 2011-08-02 Nvidia Corporation Transmitting commands and information between a TCP/IP stack and an offload unit
US20080056124A1 (en) * 2003-06-05 2008-03-06 Sameer Nanda Using TCP/IP offload to accelerate packet filtering
US20040246974A1 (en) * 2003-06-05 2004-12-09 Gyugyi Paul J. Storing and accessing TCP connection information
US20050016386A1 (en) * 2003-06-19 2005-01-27 Seb S.A. Device for filtration of the frying bath in an electric fryer having an immersed heating resistor
US20050180322A1 (en) * 2003-07-15 2005-08-18 Lok Ying P. TCP time stamp processing in hardware based TCP offload
US7420991B2 (en) 2003-07-15 2008-09-02 Qlogic, Corporation TCP time stamp processing in hardware based TCP offload
US7646767B2 (en) 2003-07-21 2010-01-12 Qlogic, Corporation Method and system for programmable data dependant network routing
US20100228901A1 (en) * 2003-08-12 2010-09-09 Takashi Tamura Input output control apparatus with a plurality of ports and single protocol processing circuit
US8090893B2 (en) * 2003-08-12 2012-01-03 Hitachi, Ltd. Input output control apparatus with a plurality of ports and single protocol processing circuit
US8176545B1 (en) 2003-12-19 2012-05-08 Nvidia Corporation Integrated policy checking system and method
US7899913B2 (en) 2003-12-19 2011-03-01 Nvidia Corporation Connection management system and method for a transport offload engine
US8549170B2 (en) 2003-12-19 2013-10-01 Nvidia Corporation Retransmission system and method for a transport offload engine
US8065439B1 (en) 2003-12-19 2011-11-22 Nvidia Corporation System and method for using metadata in the context of a transport offload engine
US20050198400A1 (en) * 2003-12-30 2005-09-08 Intel Corporation, A Delaware Corporation Systems and methods using nic-based prefetching for host TCP context lookup
US7720930B2 (en) * 2003-12-30 2010-05-18 Intel Corporation Systems and methods using NIC-based prefetching for host TCP context lookup
US7647416B2 (en) 2004-03-02 2010-01-12 Industrial Technology Research Institute Full hardware based TCP/IP traffic offload engine(TOE) device and the method thereof
US20050195833A1 (en) * 2004-03-02 2005-09-08 Hsin-Chieh Chiang Full hardware based TCP/IP traffic offload engine(TOE) device and the method thereof
US9338100B2 (en) 2004-03-26 2016-05-10 Foundry Networks, Llc Method and apparatus for aggregating input data streams
US7817659B2 (en) 2004-03-26 2010-10-19 Foundry Networks, Llc Method and apparatus for aggregating input data streams
US8493988B2 (en) 2004-03-26 2013-07-23 Foundry Networks, Llc Method and apparatus for aggregating input data streams
US7698413B1 (en) 2004-04-12 2010-04-13 Nvidia Corporation Method and apparatus for accessing and maintaining socket control information for high speed network connections
US7930377B2 (en) 2004-04-23 2011-04-19 Qlogic, Corporation Method and system for using boot servers in networks
US8730961B1 (en) 2004-04-26 2014-05-20 Foundry Networks, Llc System and method for optimizing router lookup
US7206864B2 (en) 2004-04-28 2007-04-17 Hitachi, Ltd. Network protocol processing device
US20050246450A1 (en) * 2004-04-28 2005-11-03 Yutaka Enko Network protocol processing device
US7669190B2 (en) 2004-05-18 2010-02-23 Qlogic, Corporation Method and system for efficiently recording processor events in host bus adapters
US7831745B1 (en) 2004-05-25 2010-11-09 Chelsio Communications, Inc. Scalable direct memory access using validation of host and scatter gather engine (SGE) generation indications
US7945705B1 (en) 2004-05-25 2011-05-17 Chelsio Communications, Inc. Method for using a protocol language to avoid separate channels for control messages involving encapsulated payload data messages
US20060002210A1 (en) * 2004-06-30 2006-01-05 David Thomas S Ethernet controller with excess on-board flash for microcontroller interface
US7624157B2 (en) 2004-06-30 2009-11-24 Silicon Laboratories Inc. Ethernet controller with excess on-board flash for microcontroller interface
US20060004926A1 (en) * 2004-06-30 2006-01-05 David Thomas S Smart buffer caching using look aside buffer for ethernet
US7917906B2 (en) 2004-07-02 2011-03-29 Seagate Technology Llc Resource allocation in a computer-based system
US20060005196A1 (en) * 2004-07-02 2006-01-05 Seagate Technology Llc Resource allocation in a computer-based system
US20060023731A1 (en) * 2004-07-29 2006-02-02 Eduardo Asbun Method and apparatus for processing data in a communication system
US20060047868A1 (en) * 2004-09-01 2006-03-02 Derek Rohde Method and system for efficiently using buffer space
US7761608B2 (en) 2004-09-01 2010-07-20 Qlogic, Corporation Method and system for processing markers, data integrity fields and digests
US7522623B2 (en) 2004-09-01 2009-04-21 Qlogic, Corporation Method and system for efficiently using buffer space
US20060047904A1 (en) * 2004-09-01 2006-03-02 Derek Rohde Method and system for processing markers, data integrity fields and digests
US7895431B2 (en) 2004-09-10 2011-02-22 Cavium Networks, Inc. Packet queuing, scheduling and ordering
US20060056406A1 (en) * 2004-09-10 2006-03-16 Cavium Networks Packet queuing, scheduling and ordering
US7676611B2 (en) 2004-10-01 2010-03-09 Qlogic, Corporation Method and system for processing out of orders frames
US20060075165A1 (en) * 2004-10-01 2006-04-06 Hui Ben K Method and system for processing out of order frames
US8248939B1 (en) 2004-10-08 2012-08-21 Alacritech, Inc. Transferring control of TCP connections between hierarchy of processing mechanisms
US7953923B2 (en) 2004-10-29 2011-05-31 Foundry Networks, Llc Double density content addressable memory (CAM) lookup scheme
US20060092934A1 (en) * 2004-10-29 2006-05-04 Industrial Technology Research Institute System for protocol processing engine
US7447230B2 (en) 2004-10-29 2008-11-04 Industrial Technology Research Institute System for protocol processing engine
US7953922B2 (en) 2004-10-29 2011-05-31 Foundry Networks, Llc Double density content addressable memory (CAM) lookup scheme
US20060123123A1 (en) * 2004-12-08 2006-06-08 Electronics And Telecommunications Research Institute Hardware device and method for creation and management of toe-based socket information
US7756961B2 (en) * 2004-12-08 2010-07-13 Electronics And Telecommunications Research Institute Hardware device and method for creation and management of toe-based socket information
US10580518B2 (en) 2005-03-03 2020-03-03 Washington University Method and apparatus for performing similarity searching
US10957423B2 (en) 2005-03-03 2021-03-23 Washington University Method and apparatus for performing similarity searching
US20060212777A1 (en) * 2005-03-14 2006-09-21 Fujitsu Limited Medium storage device and write path diagnosis method
US20060227811A1 (en) * 2005-04-08 2006-10-12 Hussain Muhammad R TCP engine
US7535907B2 (en) 2005-04-08 2009-05-19 Oavium Networks, Inc. TCP engine
US20060282560A1 (en) * 2005-06-08 2006-12-14 Intel Corporation Method and apparatus to reduce latency and improve throughput of input/output data in a processor
US7480747B2 (en) * 2005-06-08 2009-01-20 Intel Corporation Method and apparatus to reduce latency and improve throughput of input/output data in a processor
US7616563B1 (en) 2005-08-31 2009-11-10 Chelsio Communications, Inc. Method to implement an L4-L7 switch using split connections and an offloading NIC
US8139482B1 (en) 2005-08-31 2012-03-20 Chelsio Communications, Inc. Method to implement an L4-L7 switch using split connections and an offloading NIC
US8155001B1 (en) 2005-08-31 2012-04-10 Chelsio Communications, Inc. Protocol offload transmit traffic management
US8339952B1 (en) 2005-08-31 2012-12-25 Chelsio Communications, Inc. Protocol offload transmit traffic management
US7724658B1 (en) 2005-08-31 2010-05-25 Chelsio Communications, Inc. Protocol offload transmit traffic management
US7639715B1 (en) 2005-09-09 2009-12-29 Qlogic, Corporation Dedicated application interface for network systems
US20070073966A1 (en) * 2005-09-23 2007-03-29 Corbin John R Network processor-based storage controller, compute element and method of using same
US7760733B1 (en) 2005-10-13 2010-07-20 Chelsio Communications, Inc. Filtering ingress packets in network interface circuitry
US7715436B1 (en) 2005-11-18 2010-05-11 Chelsio Communications, Inc. Method for UDP transmit protocol offload processing with traffic management
US7738500B1 (en) 2005-12-14 2010-06-15 Alacritech, Inc. TCP timestamp synchronization for network connections that are offloaded to network interface devices
US20070140297A1 (en) * 2005-12-16 2007-06-21 Shen-Ming Chung Extensible protocol processing system
US7580410B2 (en) 2005-12-16 2009-08-25 Industrial Technology Research Institute Extensible protocol processing system
US8213427B1 (en) 2005-12-19 2012-07-03 Chelsio Communications, Inc. Method for traffic scheduling in intelligent network interface circuitry
US7660264B1 (en) 2005-12-19 2010-02-09 Chelsio Communications, Inc. Method for traffic schedulign in intelligent network interface circuitry
US9378005B2 (en) 2005-12-28 2016-06-28 Foundry Networks, Llc Hitless software upgrades
US8448162B2 (en) 2005-12-28 2013-05-21 Foundry Networks, Llc Hitless software upgrades
US8686838B1 (en) 2006-01-12 2014-04-01 Chelsio Communications, Inc. Virtualizing the operation of intelligent network interface circuitry
US7924840B1 (en) 2006-01-12 2011-04-12 Chelsio Communications, Inc. Virtualizing the operation of intelligent network interface circuitry
US7660306B1 (en) 2006-01-12 2010-02-09 Chelsio Communications, Inc. Virtualizing the operation of intelligent network interface circuitry
US8699521B2 (en) 2006-01-19 2014-04-15 Intel-Ne, Inc. Apparatus and method for in-line insertion and removal of markers
US7782905B2 (en) 2006-01-19 2010-08-24 Intel-Ne, Inc. Apparatus and method for stateless CRC calculation
US20070165672A1 (en) * 2006-01-19 2007-07-19 Neteffect, Inc. Apparatus and method for stateless CRC calculation
US9276993B2 (en) 2006-01-19 2016-03-01 Intel-Ne, Inc. Apparatus and method for in-line insertion and removal of markers
US20110099243A1 (en) * 2006-01-19 2011-04-28 Keels Kenneth G Apparatus and method for in-line insertion and removal of markers
US8316156B2 (en) 2006-02-17 2012-11-20 Intel-Ne, Inc. Method and apparatus for interfacing device drivers to single multi-function adapter
US8271694B2 (en) 2006-02-17 2012-09-18 Intel-Ne, Inc. Method and apparatus for using a single multi-function adapter with different operating systems
US8032664B2 (en) 2006-02-17 2011-10-04 Intel-Ne, Inc. Method and apparatus for using a single multi-function adapter with different operating systems
US8489778B2 (en) 2006-02-17 2013-07-16 Intel-Ne, Inc. Method and apparatus for using a single multi-function adapter with different operating systems
US20100332694A1 (en) * 2006-02-17 2010-12-30 Sharp Robert O Method and apparatus for using a single multi-function adapter with different operating systems
US20080040519A1 (en) * 2006-05-02 2008-02-14 Alacritech, Inc. Network interface device with 10 Gb/s full-duplex transfer rate
US7684402B2 (en) * 2006-05-15 2010-03-23 Faraday Technology Corp. Method and network device for fast look-up in a connection-oriented communication
US20070263620A1 (en) * 2006-05-15 2007-11-15 Chih-Feng Chien Method and Network Device for Fast Look-up in a Connection-oriented Communication
US10169814B2 (en) 2006-06-19 2019-01-01 Ip Reservoir, Llc High speed processing of financial information using FPGA devices
US11182856B2 (en) 2006-06-19 2021-11-23 Exegy Incorporated System and method for routing of streaming data as between multiple compute resources
US10360632B2 (en) 2006-06-19 2019-07-23 Ip Reservoir, Llc Fast track routing of streaming data using FPGA devices
US10817945B2 (en) 2006-06-19 2020-10-27 Ip Reservoir, Llc System and method for routing of streaming data as between multiple compute resources
US10504184B2 (en) 2006-06-19 2019-12-10 Ip Reservoir, Llc Fast track routing of streaming data as between multiple compute resources
US10467692B2 (en) 2006-06-19 2019-11-05 Ip Reservoir, Llc High speed processing of financial information using FPGA devices
EP2552080A2 (en) 2006-07-10 2013-01-30 Solarflare Communications Inc Chimney onload implementation of network protocol stack
US7903654B2 (en) 2006-08-22 2011-03-08 Foundry Networks, Llc System and method for ECMP load sharing
US8238255B2 (en) 2006-11-22 2012-08-07 Foundry Networks, Llc Recovering from failures without impact on data traffic in a shared bus architecture
US9030943B2 (en) 2006-11-22 2015-05-12 Foundry Networks, Llc Recovering from failures without impact on data traffic in a shared bus architecture
US20080133798A1 (en) * 2006-12-04 2008-06-05 Electronics And Telecommunications Research Institute Packet receiving hardware apparatus for tcp offload engine and receiving system and method using the same
US7849214B2 (en) 2006-12-04 2010-12-07 Electronics And Telecommunications Research Institute Packet receiving hardware apparatus for TCP offload engine and receiving system and method using the same
US8155011B2 (en) 2007-01-11 2012-04-10 Foundry Networks, Llc Techniques for using dual memory structures for processing failure detection protocol packets
US7978614B2 (en) 2007-01-11 2011-07-12 Foundry Network, LLC Techniques for detecting non-receipt of fault detection protocol packets
US9112780B2 (en) 2007-01-11 2015-08-18 Foundry Networks, Llc Techniques for processing incoming failure detection protocol packets
US8395996B2 (en) 2007-01-11 2013-03-12 Foundry Networks, Llc Techniques for processing incoming failure detection protocol packets
US8935406B1 (en) * 2007-04-16 2015-01-13 Chelsio Communications, Inc. Network adaptor configured for connection establishment offload
US9537878B1 (en) 2007-04-16 2017-01-03 Chelsio Communications, Inc. Network adaptor configured for connection establishment offload
US20080263171A1 (en) * 2007-04-19 2008-10-23 Alacritech, Inc. Peripheral device that DMAS the same data to different locations in a computer
US7826350B1 (en) 2007-05-11 2010-11-02 Chelsio Communications, Inc. Intelligent network adaptor with adaptive direct data placement scheme
US8356112B1 (en) 2007-05-11 2013-01-15 Chelsio Communications, Inc. Intelligent network adaptor with end-to-end flow control
US8589587B1 (en) 2007-05-11 2013-11-19 Chelsio Communications, Inc. Protocol offload in intelligent network adaptor, including application level signalling
US8060644B1 (en) 2007-05-11 2011-11-15 Chelsio Communications, Inc. Intelligent network adaptor with end-to-end flow control
US7831720B1 (en) 2007-05-17 2010-11-09 Chelsio Communications, Inc. Full offload of stateful connections, with partial connection offload
US8271859B2 (en) 2007-07-18 2012-09-18 Foundry Networks Llc Segmented CRC design in high speed networks
US8037399B2 (en) 2007-07-18 2011-10-11 Foundry Networks, Llc Techniques for segmented CRC design in high speed networks
US8509236B2 (en) 2007-09-26 2013-08-13 Foundry Networks, Llc Techniques for selecting paths and/or trunk ports for forwarding traffic flows
US8149839B1 (en) 2007-09-26 2012-04-03 Foundry Networks, Llc Selection of trunk ports and paths using rotation
US8539513B1 (en) 2008-04-01 2013-09-17 Alacritech, Inc. Accelerating data transfer in a virtual computer system with tightly coupled TCP connections
US8893159B1 (en) 2008-04-01 2014-11-18 Alacritech, Inc. Accelerating data transfer in a virtual computer system with tightly coupled TCP connections
US8341286B1 (en) 2008-07-31 2012-12-25 Alacritech, Inc. TCP offload send optimization
US9667729B1 (en) 2008-07-31 2017-05-30 Alacritech, Inc. TCP offload send optimization
US9413788B1 (en) 2008-07-31 2016-08-09 Alacritech, Inc. TCP offload send optimization
US9306793B1 (en) 2008-10-22 2016-04-05 Alacritech, Inc. TCP offload device that batches session layer headers to reduce interrupts as well as CPU copies
US10062115B2 (en) 2008-12-15 2018-08-28 Ip Reservoir, Llc Method and apparatus for high-speed processing of financial market depth data
US10929930B2 (en) 2008-12-15 2021-02-23 Ip Reservoir, Llc Method and apparatus for high-speed processing of financial market depth data
US11676206B2 (en) 2008-12-15 2023-06-13 Exegy Incorporated Method and apparatus for high-speed processing of financial market depth data
US8090901B2 (en) 2009-05-14 2012-01-03 Brocade Communications Systems, Inc. TCAM management approach that minimize movements
US9166818B2 (en) 2009-09-21 2015-10-20 Brocade Communications Systems, Inc. Provisioning single or multistage networks using ethernet service instances (ESIs)
US8599850B2 (en) 2009-09-21 2013-12-03 Brocade Communications Systems, Inc. Provisioning single or multistage networks using ethernet service instances (ESIs)
US20130103852A1 (en) * 2010-06-30 2013-04-25 Heeyoung Jung Communication node and communication method
US9367514B2 (en) * 2010-06-30 2016-06-14 Intellectual Discovery Co., Ltd. Communication node and communication method
US11132317B2 (en) 2010-12-09 2021-09-28 Xilinx, Inc. Encapsulated accelerator
US9880964B2 (en) 2010-12-09 2018-01-30 Solarflare Communications, Inc. Encapsulated accelerator
US11397985B2 (en) 2010-12-09 2022-07-26 Exegy Incorporated Method and apparatus for managing orders in financial markets
US9674318B2 (en) * 2010-12-09 2017-06-06 Solarflare Communications, Inc. TCP processing for devices
US10037568B2 (en) 2010-12-09 2018-07-31 Ip Reservoir, Llc Method and apparatus for managing orders in financial markets
US20170214775A1 (en) * 2010-12-09 2017-07-27 Solarflare Communications, Inc Tcp processing for devices
US11876880B2 (en) * 2010-12-09 2024-01-16 Xilinx, Inc. TCP processing for devices
US20140310405A1 (en) * 2010-12-09 2014-10-16 Solarflare Communications, Inc. Tcp processing for devices
US11134140B2 (en) * 2010-12-09 2021-09-28 Xilinx, Inc. TCP processing for devices
US10515037B2 (en) 2010-12-09 2019-12-24 Solarflare Communications, Inc. Encapsulated accelerator
US10873613B2 (en) 2010-12-09 2020-12-22 Xilinx, Inc. TCP processing for devices
US10572417B2 (en) 2010-12-09 2020-02-25 Xilinx, Inc. Encapsulated accelerator
US9600429B2 (en) 2010-12-09 2017-03-21 Solarflare Communications, Inc. Encapsulated accelerator
US20170026497A1 (en) * 2010-12-09 2017-01-26 Solarflare Communications, Inc. Tcp processing for devices
US11803912B2 (en) 2010-12-09 2023-10-31 Exegy Incorporated Method and apparatus for managing orders in financial markets
US9892082B2 (en) 2010-12-09 2018-02-13 Solarflare Communications Inc. Encapsulated accelerator
US9258390B2 (en) 2011-07-29 2016-02-09 Solarflare Communications, Inc. Reducing network latency
US10021223B2 (en) 2011-07-29 2018-07-10 Solarflare Communications, Inc. Reducing network latency
US10469632B2 (en) 2011-07-29 2019-11-05 Solarflare Communications, Inc. Reducing network latency
US9456060B2 (en) 2011-07-29 2016-09-27 Solarflare Communications, Inc. Reducing network latency
US10425512B2 (en) 2011-07-29 2019-09-24 Solarflare Communications, Inc. Reducing network latency
US10650452B2 (en) 2012-03-27 2020-05-12 Ip Reservoir, Llc Offload processing of data packets
US10872078B2 (en) 2012-03-27 2020-12-22 Ip Reservoir, Llc Intelligent feed switch
US9990393B2 (en) 2012-03-27 2018-06-05 Ip Reservoir, Llc Intelligent feed switch
US11436672B2 (en) 2012-03-27 2022-09-06 Exegy Incorporated Intelligent switch for processing financial market data
US10963962B2 (en) 2012-03-27 2021-03-30 Ip Reservoir, Llc Offload processing of data packets containing financial market data
US10121196B2 (en) 2012-03-27 2018-11-06 Ip Reservoir, Llc Offload processing of data packets containing financial market data
US20140180904A1 (en) * 2012-03-27 2014-06-26 Ip Reservoir, Llc Offload Processing of Data Packets Containing Financial Market Data
US9621964B2 (en) 2012-09-30 2017-04-11 Oracle International Corporation Aborting data stream using a location value
US10505747B2 (en) 2012-10-16 2019-12-10 Solarflare Communications, Inc. Feed processing
US11374777B2 (en) 2012-10-16 2022-06-28 Xilinx, Inc. Feed processing
US9893997B2 (en) 2016-04-07 2018-02-13 Nxp Usa,Inc. System and method for creating session entry
US10440158B2 (en) * 2016-06-01 2019-10-08 Intel IP Corporation Data processing device and method for offloading data to remote data processing device
US11019184B2 (en) 2016-06-01 2021-05-25 Intel IP Corporation Data processing device and method for offloading data to remote data processing device
US11165720B2 (en) 2017-12-19 2021-11-02 Xilinx, Inc. Network interface device
US11394664B2 (en) 2017-12-19 2022-07-19 Xilinx, Inc. Network interface device
US11394768B2 (en) 2017-12-19 2022-07-19 Xilinx, Inc. Network interface device
US10686872B2 (en) 2017-12-19 2020-06-16 Xilinx, Inc. Network interface device
US10686731B2 (en) 2017-12-19 2020-06-16 Xilinx, Inc. Network interface device
US11429438B2 (en) 2018-07-17 2022-08-30 Xilinx, Inc. Network interface device and host processing device
US10659555B2 (en) 2018-07-17 2020-05-19 Xilinx, Inc. Network interface device and host processing device
US10838763B2 (en) 2018-07-17 2020-11-17 Xilinx, Inc. Network interface device and host processing device
US11665087B2 (en) 2021-09-15 2023-05-30 International Business Machines Corporation Transparent service-aware multi-path networking with a feature of multiplexing

Also Published As

Publication number Publication date
US20020147839A1 (en) 2002-10-10

Similar Documents

Publication Publication Date Title
US6591302B2 (en) Fast-path apparatus for receiving data corresponding to a TCP connection
US6965941B2 (en) Transmit fast-path processing on TCP/IP offload network interface device
US7089326B2 (en) Fast-path processing for receiving data on TCP connection offload devices
US6427173B1 (en) Intelligent network interfaced device and system for accelerated communication
US6389479B1 (en) Intelligent network interface device and system for accelerated communication
EP1330725B1 (en) Intelligent network storage interface system and devices
US6807581B1 (en) Intelligent network storage interface system
US8019901B2 (en) Intelligent network storage interface system
US7076568B2 (en) Data communication apparatus for computer intelligent network interface card which transfers data between a network and a storage device according designated uniform datagram protocol socket
US7664883B2 (en) Network interface device that fast-path processes solicited session layer read commands
US7502869B2 (en) Intelligent network interface system and method for accelerated protocol processing
US7284070B2 (en) TCP offload network interface device
US7673072B2 (en) Fast-path apparatus for transmitting data corresponding to a TCP connection
US7191241B2 (en) Fast-path apparatus for receiving data corresponding to a TCP connection
US20040064578A1 (en) Fast-path apparatus for receiving data corresponding to a TCP connection
US8621101B1 (en) Intelligent network storage interface device

Legal Events

Date Code Title Description
AS Assignment

Owner name: ALACRITECH, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BOUCHER, LAURENCE B.;BLIGHTMAN, STEPHAN E.J.;CRAFT, PETER K.;AND OTHERS;REEL/FRAME:012687/0739;SIGNING DATES FROM 20020221 TO 20020227

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: A-TECH LLC, DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ALACRITECH INC.;REEL/FRAME:031644/0783

Effective date: 20131017

FPAY Fee payment

Year of fee payment: 12

AS Assignment

Owner name: ALACRITECH, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:A-TECH LLC;REEL/FRAME:039068/0884

Effective date: 20160617