Manual Cisco Systems ST373307LC

74 pages 0.81 mb
Download

Go to site of 74

Summary
  • Cisco Systems ST373307LC - page 1

    Americas Headquarters Cisco Systems, In c. 170 West Tasman Drive San Jose, CA 951 34-1706 USA http://www.ci sco.com Tel: 408 526-4000 800 553-NETS (638 7) Fax: 408 527-0883 Cisco SFS Inf iniBand Host Driv er s User Guide f or Linux Re lease 3.2.0 June 20 07 Text Part Number: OL -12309-01 ...

  • Cisco Systems ST373307LC - page 2

    THE SPECIFICATION S AND INFORMAT ION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT T O CHANGE WITH OUT NOTICE. A LL STATEMENTS , INFORMATION, AND RECOMMENDATI ONS IN THI S MANUAL ARE BE LIEVED TO BE A CCURATE BUT ARE PRESENTED WI THOUT WARRANTY OF ANY KIND, EX PRESS OR IMPLIED. USERS MUST TAKE FULL RESPO NSIBILITY FOR THEIR APPLICAT ION OF ANY ...

  • Cisco Systems ST373307LC - page 3

    iii Cisco SFS InfiniBand Host Dr ivers User Guide for Linux OL-12309-01 CONTENTS Preface vii Audience vii Organization vii Conventi ons viii Root and Non-root Con ventions in Examples ix Related Documentation ix Obtaining Documentation, Obtaining Support, and Security Guid elines ix CHAPTER 1 About Host Drivers 1-1 Introduction 1-1 Architecture 1-2 ...

  • Cisco Systems ST373307LC - page 4

    Contents iv Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Subinterfaces 3-2 Creating a Subinterface Associated with a Specific IB Partition 3-3 Removing a Subinterface Associated with a Spe cific IB Partition 3-4 Verifying IPoIB Functionality 3-5 IPoIB Performance 3-6 Sample Startup Config uration File 3-8 IPoIB High Availabil ...

  • Cisco Systems ST373307LC - page 5

    Contents v Cisco SFS InfiniBand Host Dr ivers User Guide for Linux OL-12309-01 CHAPTER 7 MVAPICH MPI 7-1 Introduction 7-1 Initial Setup 7-2 Configuring SSH 7-2 Editing Environment Variables 7-5 Setting Environment Variables in System-Wide Startup File s 7-6 Editing Environment Variables in the Users Shell Startup Files 7-6 Editing Environment Varia ...

  • Cisco Systems ST373307LC - page 6

    Contents vi Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 ...

  • Cisco Systems ST373307LC - page 7

    vii Cisco SFS InfiniBand Host Dr ivers User Guide for Linux OL-12309-01 Preface This preface describes who shoul d read the Cisco SFS Infi niBand Host Drivers User Guide fo r Linux , ho w it is or ganized, and it s document con v entions. It in cludes the follo wing section s: • Audience, pag e vii • Org anization, page vii • Con v entions, p ...

  • Cisco Systems ST373307LC - page 8

    viii Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Preface Conventions Conventions This document uses the f ollo wing con ventions: Chapter 8 HCA Utilities and Diag nostics Describes the fundamen tal HCA utilities and diagnostics. Appendix A Acronyms an d Abbre viations Defines the acron yms and abbre viations that are used in ...

  • Cisco Systems ST373307LC - page 9

    ix Cisco SFS InfiniBand Host Dr ivers User Guide for Linux OL-12309-01 Preface Root and Non-root Conventions in E xamples Notes use the follo wing con vention: Note Means reader take note . Notes contain helpful suggestions or references to material not co vered in the manual. Cautions use the following con v ention: Caution Means reader be car efu ...

  • Cisco Systems ST373307LC - page 10

    x Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Preface Obtaining Documentation, Obtaining Support, and Security G uidelines ...

  • Cisco Systems ST373307LC - page 11

    CH A P T E R 1-1 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 1 About Host Drivers This chapter describes host driv ers and includes the following sections: • Introduction, page 1-1 • Architecture, page 1-2 • Supported Protoc ols, page 1-3 • Supported APIs, page 1-4 • HCA Utilities and D iagnostics, page 1-4 Note For ...

  • Cisco Systems ST373307LC - page 12

    1-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 1 Abo ut Host Drivers Architecture Note See the “Root and Non-root Con v entions in Examples” section on page ix for details about the significance of prompt s used in the e xamples in this chapter . Architecture Figure 1-1 displays the software architect ure of the ...

  • Cisco Systems ST373307LC - page 13

    1-3 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 1 About Hos t Drivers Supported Protocols Supported Protocols This section des cribes the suppo rted protocols an d includes the fol lowing topics: • IPoIB • SRP • SDP Protocol here refers to software in the networking layer in kernel space. IPoIB The IPoIB protoco ...

  • Cisco Systems ST373307LC - page 14

    1-4 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 1 Abo ut Host Drivers Supported APIs Supported APIs This section descri bes the supported APIs and includes t he follo wing topics: • MV APICH MPI • uD APL • Intel MPI • HP MPI API refers to software in the network ing layer in user space. MVAPICH MPI MPI is a s ...

  • Cisco Systems ST373307LC - page 15

    CH A P T E R 2-1 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 2 Installing Host Drivers The chapter includes th e following sections: • Introduction, page 2-1 • Contents of ISO Image, page 2-2 • Installing Host Driv ers from an ISO Image, page 2-2 • Uninstalling Host Drivers from an ISO Image, page 2-3 Note See the “ ...

  • Cisco Systems ST373307LC - page 16

    2-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 2 Installing Host Drivers Contents of ISO Image Contents of ISO Image The ISO image contains the follo wing directori es and files: • docs/ This directory contains the related documents. • tsinstall This is the inst allation scri pt. • redhat/ This directory conta ...

  • Cisco Systems ST373307LC - page 17

    2-3 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 2 In stalling Host Drivers Uninstalling Host Drivers from an ISO Image topspin-ib-mpi-rhel4-3.2.0-136.x86_64 (MPI libraries, source code, docs, etc) topspin-ib-mod-rhel4-2.6.9-34.ELsmp-3.2.0-136.x86_64 (kernel modules) installing 100% #################################### ...

  • Cisco Systems ST373307LC - page 18

    2-4 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 2 Installing Host Drivers Uninstalling Host Drivers from an ISO Image ...

  • Cisco Systems ST373307LC - page 19

    CH A P T E R 3-1 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 3 IP over IB Protocol This chapter describe s IP over IB protocol and includes the following sections : • Introduction, page 3-1 • Manually Conf iguring IPoIB for Def ault IB Partit ion, page 3-2 • Subinterfaces, page 3- 2 • V erifying IPoIB Functi onality , ...

  • Cisco Systems ST373307LC - page 20

    3-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 3 IP over IB Protocol Manually Configuring IPoI B for Default IB Part ition Manually Configuring IPoI B for Default IB Partition T o manually conf igure IPoIB for the def ault IB partition, perform th e follo wing steps: Step 1 Log in to your Linu x host. Step 2 T o con ...

  • Cisco Systems ST373307LC - page 21

    3-3 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 3 IP over IB Protocol Subinterfaces Creating a Subinterface Associated with a Specific IB Partition T o create a subinterface associat ed with a specific IB partition , perform the follo wing steps: Step 1 Create a partition on an IB SFS. Alternativ ely , you can choose ...

  • Cisco Systems ST373307LC - page 22

    3-4 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 3 IP over IB Protocol Subinterface s NOARP MTU:1480 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) V erify that you see the ib0.8002 output. ...

  • Cisco Systems ST373307LC - page 23

    3-5 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 3 IP over IB Protocol Verifying IPoIB Functionality TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1024 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP L ...

  • Cisco Systems ST373307LC - page 24

    3-6 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 3 IP over IB Protocol IPoIB Performa nce IPoIB Performance This section describes ho w to verify IPoIB performance by ru nning the Bandwidth test and the Latenc y test. These tests are described in de tail at the fo llowing URL: http://www .netperf.or g/netperf/t rainin ...

  • Cisco Systems ST373307LC - page 25

    3-7 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 3 IP over IB Protocol IPoIB Performance Step 5 Run the Netperf Latenc y test. Run the test once, and stop the server so that it does no t repeat the test. The follo wing e xample sho ws ho w to run the Latency test, and then stop the Netperf serv er: host2$ netperf -H 19 ...

  • Cisco Systems ST373307LC - page 26

    3-8 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 3 IP over IB Protocol Sample Startup Configuration File Sample Startup Configuration File IP addresses that are con figur ed manually are not pe rsistent across reboots. Y ou must use a conf iguration file to config ure IPoIB when the host boots. T wo samp le config ura ...

  • Cisco Systems ST373307LC - page 27

    3-9 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 3 IP over IB Protocol IPoIB High Availability Step 3 T ake the i nterfaces of fline. Y ou cannot mer ge interfaces u ntil you bring them down. The follo wing e xample sho ws ho w to take the interf aces off line: host1# ifconfig ib0 down host1# ifconfig ib1 down Step 4 M ...

  • Cisco Systems ST373307LC - page 28

    3-10 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 3 IP over IB Protocol IPoIB High Availability Step 3 Display the a vai lable interfaces b y entering the ipoibcfg list command. The follo wing example sho ws how to display the a v ailable interfaces: host1# /usr/local/topspin/sbin/ipoibcfg list ib0 (P_Key 0xffff) (SL: ...

  • Cisco Systems ST373307LC - page 29

    CH A P T E R 4-1 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 4 SCSI RDMA Protocol This chapter describe s SCSI RDMA protocol and includes the following sections: • Introduction, page 4-1 • Config uring SRP , page 4-1 • V erifying SRP , page 4-7 Note See the “Root and Non-root Con v entions in Examples” section on pa ...

  • Cisco Systems ST373307LC - page 30

    4-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 4 SCSI RDMA Protocol Configuring SRP This section contains informati on on how to co nfigu re your IB fabric to connect an SRP host to a SAN and includes the follo wing topics: • Config uring ITLs when Using Fibr e Channel Gate way , page 4-2 • Config uring SRP Host ...

  • Cisco Systems ST373307LC - page 31

    4-3 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 4 SCSI RDMA Protocol Configuring SRP Step 3 Bring up the Fibre Channel gate ways on yo ur SFS, b y performing the follo wing steps: a. Launch Eleme nt Manager . b. Double-click the Fibre Chan nel gate way card that you w ant to bring up. The Fibre Channel Card windo w op ...

  • Cisco Systems ST373307LC - page 32

    4-4 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 4 SCSI RDMA Protocol Configuring SRP Configuring ITLs with Element Manager wh ile Global Policy Restrictions Apply This section descri bes how to conf igure ITLs with Element Manager while global po licy restrictions apply . These instructions apply to en vironmen ts wh ...

  • Cisco Systems ST373307LC - page 33

    4-5 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 4 SCSI RDMA Protocol Configuring SRP Step 9 Click the Next > b utton. The Def ine Ne w SRP Host windo w displays a recommend ed WWNN for the host and recommended WWPNs that represent the host on all exist ing and potential Fibre Channel gatew ay ports. Note Although y ...

  • Cisco Systems ST373307LC - page 34

    4-6 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 4 SCSI RDMA Protocol Configuring SRP Configuring SRP Host This section descri bes how to configu re the SRP host. The SRP host dri ver exposes a Fibre Chan nel target (identified by a WWPN) as a SCS I target to the Linux SCSI mid-layer . In turn, the mid-layer creates L ...

  • Cisco Systems ST373307LC - page 35

    4-7 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 4 SCSI RDMA Protocol Verifying SRP Verifying SRP This section describes h ow t o verify SRP f unctional ity and veri fy SRP host-to- storage connections with the Element Manager GUI and includes the following sections: • V erifying SRP Functional ity , page 4-7 • V e ...

  • Cisco Systems ST373307LC - page 36

    4-8 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 4 SCSI RDMA Protocol Verifying SRP 512000 inodes, 1023996 blocks 51199 blocks (5.00%) reserved for the super user First data block=0 Maximum filesystem blocks=1048576000 32 block groups 32768 blocks per group, 32768 fragments per group 16000 inodes per group Superblock ...

  • Cisco Systems ST373307LC - page 37

    CH A P T E R 5-1 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 5 Sockets Direct Protocol This chapter describes the Sock ets Direct Protocol and in cludes the follo wing sections : • Introduction, page 5-1 • Config uring IPoIB Interf aces, page 5-1 . • Con v erting Sockets- Based Application, page 5-2 • SDP Performance, ...

  • Cisco Systems ST373307LC - page 38

    5-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 5 Soc kets Direct Protocol Converting Sockets-Based Application Converting Sockets-Based Application This section describes ho w to co n ver t sockets-based applications. Y ou can con vert your sockets-b ased applications to use SDP instead of TCP b y using one of two c ...

  • Cisco Systems ST373307LC - page 39

    5-3 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 5 Sockets Direct Protoco l Converting Sockets-Based Application Log Statement This section describes the lo g statement. The log di rect iv e allo ws the u ser to specif y which deb ug and error messages are sent and where they are se nt. The log stat ement format is as ...

  • Cisco Systems ST373307LC - page 40

    5-4 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 5 Soc kets Direct Protocol SDP Performance The ip_port matches against an IP address, prefix length, and port range. The format is as follo ws: ip_addr [/ prefix _length ][: start_po rt [- end_port ]] The pref ix length is option al and missing defaults t o /32 (length ...

  • Cisco Systems ST373307LC - page 41

    5-5 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 5 Sockets Direct Protoco l SDP Performance Socket Socket Message Elapsed Send Recv Send Recv Size Size Size Time Throughput local remote local remote bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB 87380 16384 65536 10.00 6601.82 23.79 21.37 1.181 1.061 The follo ...

  • Cisco Systems ST373307LC - page 42

    5-6 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 5 Soc kets Direct Protocol Netperf Server with IPoIB and SDP The notable pe rformance v alues in the e xample above are as follo ws: Client CPU utilizat ion is 6.26 percent of client CPU. Server CPU ut ilization is 7.22 percent of serv er CPU. Latency is 18.01 microseco ...

  • Cisco Systems ST373307LC - page 43

    5-7 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 5 Sockets Direct Protoco l Netperf Server with IPo IB and SDP The follo wing list describes paramet ers for the netperf command: The notable pe rformance v alues in the e xample above are as follo ws: Throughput is 6.60 gigabits per second. Client CPU utilizat ion is 23. ...

  • Cisco Systems ST373307LC - page 44

    5-8 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 5 Soc kets Direct Protocol Netperf Server with IPoIB and SDP ...

  • Cisco Systems ST373307LC - page 45

    CH A P T E R 6-1 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 6 uDAPL This chapter describe s uD APL and includes the follo wing sections: • Introduction, page 6-1 • uD APL T est Performance, page 6-1 • Compiling uDAPL Programs, page 6-4 Note See the “Root and Non-root Con v entions in Examples” section on pag e ix f ...

  • Cisco Systems ST373307LC - page 46

    6-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 6 uDAPL uDAPL Throughput Test Performance The Throughput test measures RDMA WRITE th roughput using uD APL. T o perform a uD APL Throughput test perfor mance, perform the follo wing step s: Step 1 Start the Throu ghput test on the serv er host. The synt ax for the serv ...

  • Cisco Systems ST373307LC - page 47

    6-3 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 6 uDAPL Step 3 V iew the Throughput test results from the serv er . The follo wing e xample sho ws the Throughput test results: Created an EP with ep_handle = 0x2a95f8a300 queried max_recv_dtos = 256 queried max_request_dtos = 1024 Accept issued... Received an event on e ...

  • Cisco Systems ST373307LC - page 48

    6-4 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 6 uDAPL host2$ /usr/local/topspin/bin/lat_client.x ib0 192.168.0.1 200000 1 0 • ib0 is the name of the device. • 192.168.0.1 is the IPoIB address of the server host. • 200000 is the number of RDMAs to p erform for the test. • 1 is the size in bytes of t he RDMA ...

  • Cisco Systems ST373307LC - page 49

    CH A P T E R 7-1 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 7 MVAPICH MPI The chapter describes MV APICH MPI and i ncludes the follo wing sections: • Introduction, page 7-1 • Initial Setup, page 7- 2 • Config uring SSH, page 7-2 • Editing En viron ment V ariables, page 7-5 • MPI Bandwidth T est Performance, page 7- ...

  • Cisco Systems ST373307LC - page 50

    7-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 7 MVAPICH MPI Initial Setup Initial Setup This section describes the initial MPI setup. MPI can be used with either IPoIB or Ethernet IP addresses. The dri vers for MPI are aut omatically loaded at boot time if IPoIB or SDP is loaded. If neither IPo IB nor SRP are used, ...

  • Cisco Systems ST373307LC - page 51

    7-3 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 7 MVAPICH MPI Configuring SSH T o conf igure SSH, perform t he follo wing steps: Step 1 Log in to the host th at you want to con figure as the local host, host1. The follo wing e xample sho ws ho w to log in to the host: login: username Password: password host1$ Note Y o ...

  • Cisco Systems ST373307LC - page 52

    7-4 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 7 MVAPICH MPI Configuring SSH Step 5 Change into the .ssh di rectory that you created. The follo wing e xample sho ws ho w to change into t he .ssh directory: host1$ cd .ssh Step 6 Copy the public key that w as just generated to the authorized keys file . The follo wing ...

  • Cisco Systems ST373307LC - page 53

    7-5 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 7 MVAPICH MPI Editing Environment Variab les Step 9 Return to host1 and cop y the authorized k eys f ile from Step 6 to the directory that you created in Ste p 8 . The follo wing e xample sho ws ho w to return to host1 a nd cop y the authorized keys f ile to the d irecto ...

  • Cisco Systems ST373307LC - page 54

    7-6 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 7 MVAPICH MPI Editing Environment Variables Setting Environment Variables in System-Wide Startup Files This method is used to set a system-wide def ault for which MPI implementation is used. This method is the easiest for end users; users wh o log in automatically ha ve ...

  • Cisco Systems ST373307LC - page 55

    7-7 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 7 MVAPICH MPI MPI Bandwidth Test Performa nce Editing Environment Variables Manually T ypically , you edit en viro nment va riables manually when it is necessary to run temporarily with a gi v en MPI implementation. For ex ample, when it is not de sirable to change the d ...

  • Cisco Systems ST373307LC - page 56

    7-8 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 7 MVAPICH MPI MPI Latency Test Per formance When the test completes successfull y , you see output that is similar to the follo wing: # OSU MPI Bandwidth Test (Version 2.2) # Size Bandwidth (MB/s) 1 3.352541 2 6.701571 4 10.738255 8 20.703599 16 39.875389 32 75.128393 6 ...

  • Cisco Systems ST373307LC - page 57

    7-9 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 7 MVAPICH MPI Intel MPI Benchmarks (IM B) Test Performance • The name of the hostf ile • The latency ex ecutable name The follo wing e xample sho ws ho w to run the MV APICH MPI Latency test: host1$ mpirun_rsh -np 2 -hostfile /tmp/hostfile /usr/local/topspin/mpi/mp ...

  • Cisco Systems ST373307LC - page 58

    7-10 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 7 MVAPICH MPI Intel MPI Benchmar ks (IMB) Test Performance When your installation is no t working prop erly , the IMB test might lead to V API_RETR Y_EXEC errors. Y ou should check the ou tput of the PingPong, Ping Ping, and Sendrecv bandwidth measurements against know ...

  • Cisco Systems ST373307LC - page 59

    7-11 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 7 MVAPICH MPI Intel MPI Benchmarks (IM B) Test Performance When the test completes su ccessfully , you see output similar to the follo wing: #--------------------------------------------------- # Intel (R) MPI Benchmark Suite V2.3, MPI-1 part #-------------------------- ...

  • Cisco Systems ST373307LC - page 60

    7-12 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 7 MVAPICH MPI Compiling MPI Programs Compiling MPI Programs This section descri bes how to compile MPI progra ms. Compi ling MPI applications from source code requires adding se ve ral compiler and link er flags. MV APICH MPI pro vides wra pper compilers th at add all ...

  • Cisco Systems ST373307LC - page 61

    7-13 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 7 MVAPICH MPI Compiling MPI Programs Step 3 Select the language and compiler of your choice from the sele ction of com piler wrapper s av ailable in Ta b l e 7 - 2 . Step 4 Compile the e xamples as sho wn here: host1$ cd $HOME/mpi-examples host1$ mpicc.i -o hello_c hell ...

  • Cisco Systems ST373307LC - page 62

    7-14 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 7 MVAPICH MPI Compiling MPI Programs ...

  • Cisco Systems ST373307LC - page 63

    CH A P T E R 8-1 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 8 HCA Utilities and Diagnostics This chapte r describes the HC A utilities and diagnostics and includes t he follo wing sect ions: • Introduction, page 8-1 • hca_self_test Utility , page 8-1 • tvflash Utility , page 8-3 • Diagnostics, page 8-5 Introduction T ...

  • Cisco Systems ST373307LC - page 64

    8-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 8 HCA Utilities and Diagnostics hca_self_test Utility Host Driver Initialization ............. PASS Number of HCA Ports Active ............. 2 Port State of Port #0 on HCA #0 ........ UP 4X Port State of Port #1 on HCA #0 ........ UP 4X Error Counter Check on HCA #0 ... ...

  • Cisco Systems ST373307LC - page 65

    8-3 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 8 HCA Utilities and Diagnostics tvflash Utility tvflash Utility This section descri bes the tvflash utility and includes the fo llowi ng topics: • V iewing Card T ype and Firmware V ersion, page 8-3 • Upgrading Firmware, page 8-4 Note The firmw are upgrade is handled ...

  • Cisco Systems ST373307LC - page 66

    8-4 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 8 HCA Utilities and Diagnostics tvflash Utility Upgrading Firmware T o upgrade f irmware on your ho st, perform the follo wing steps: Note Upon installation of the host driv ers, the f irmware is auto matically updated, if required. Ho we ver , if you ha ve outdated fir ...

  • Cisco Systems ST373307LC - page 67

    8-5 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Chapter 8 HCA Utilities and Diagnostics Diagnostics Diagnostics This section includes diagnosti cs information. A fe w diagnost ic programs are included with the Linux IB host dri vers. The vstat utility prin ts IB information. The follo wing e xample sho ws a vstat utility d is ...

  • Cisco Systems ST373307LC - page 68

    8-6 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Chapter 8 HCA Utilities and Diagnostics Diagnostics ...

  • Cisco Systems ST373307LC - page 69

    A-1 Cisco SFS InfiniBand Host Dr ivers User Guide for Linux OL-12309-01 APPENDIX A Acronyms and Abbreviations Ta b l e A - 1 defines t he acronyms and ab bre viations that are u sed in this guide. T able A -1 List of Acr on yms and Abbr eviations Acronym Expansion API Application Program Interf ace CLI command-line interf ace GUI graphical user int ...

  • Cisco Systems ST373307LC - page 70

    A-2 Cisco SFS InfiniBand Host Drivers User Guide for Lin ux OL-12309-01 Appendix A Acronyms an d Abbreviations SSH Secure Shell Protocol TCP T ransmission Cont rol Protocol uD APL User Direct Access Programming Library ULP upper-l ev el protocol WWNN world-wide node name WWPN world-wide port name T able A -1 List of A cr on yms and Abbr eviations ( ...

  • Cisco Systems ST373307LC - page 71

    IN-1 Cisco SFS InfiniBand Host Dr ivers User Guide for Linux OL-12309-01 INDEX A architecture, HCA supported 1-2 audience vii authenticity messages 7-5 B Bandwidth test default 3-6, 5-7 MPI 7-7 Netperf 5-6 using 3-6 C card type, view 8-3 CLI 4-2 command-line interface. See CLI. compile MPI programs 7-12 compiler GNU 7-1 Intel 7-1 configure IPoIB 3- ...

  • Cisco Systems ST373307LC - page 72

    Index IN-2 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 Gateway, Fibre Cha nnel 4-1 Globally Uni que Identifier. Se e GUID. global policy r estrictions 4-2, 4-4 GNU compiler 7-1 graphical u ser interface . See GUI. GUI 4-2 GUID 4-2 H HCA description 1-1 diagnostics 1-4, 8-1 firmware version 2-3 ports 2-3, 3-1 supported APIs 1- ...

  • Cisco Systems ST373307LC - page 73

    Index IN-3 Cisco SFS InfiniBand Host Dr ivers User Guide for Linux OL-12309-01 MPI Bandwidth test 7-7 compile programs 7-12 description 1-4, 7-1 Intel Benchmarks test 7-9 Latency test 7-8 MVAPICH 1-4, 7-1 tutorial 7-12 MPI implementation multiple 7-5 single 7-5 MVAPICH MPI 1-4, 7-1 N netmask 3-2 Netperf 3-6, 5-6 Netperf server 3-6, 5-6 O organizati ...

  • Cisco Systems ST373307LC - page 74

    Index IN-4 Cisco SFS InfiniBand Host Drivers User Guide for Linux OL-12309-01 log 5-3 match 5-3 storage area network. See SA N. stream sockets networking 5-1 subinterface create 3-3 description 3-2 remove 3-4 T test Bandwidth 3-6 Bandwidth, default 3-6, 5-7 Bandwidth, MPI 7-7 Bandwidth, with SDP 5-6 IMB 7-9 Intel MPI Benchmarks. See IMB. Latency 3- ...

Manufacturer Cisco Systems Category Computer Drive

Documents that we receive from a manufacturer of a Cisco Systems ST373307LC can be divided into several groups. They are, among others:
- Cisco Systems technical drawings
- ST373307LC manuals
- Cisco Systems product data sheets
- information booklets
- or energy labels Cisco Systems ST373307LC
All of them are important, but the most important information from the point of view of use of the device are in the user manual Cisco Systems ST373307LC.

A group of documents referred to as user manuals is also divided into more specific types, such as: Installation manuals Cisco Systems ST373307LC, service manual, brief instructions and user manuals Cisco Systems ST373307LC. Depending on your needs, you should look for the document you need. In our website you can view the most popular manual of the product Cisco Systems ST373307LC.

A complete manual for the device Cisco Systems ST373307LC, how should it look like?
A manual, also referred to as a user manual, or simply "instructions" is a technical document designed to assist in the use Cisco Systems ST373307LC by users. Manuals are usually written by a technical writer, but in a language understandable to all users of Cisco Systems ST373307LC.

A complete Cisco Systems manual, should contain several basic components. Some of them are less important, such as: cover / title page or copyright page. However, the remaining part should provide us with information that is important from the point of view of the user.

1. Preface and tips on how to use the manual Cisco Systems ST373307LC - At the beginning of each manual we should find clues about how to use the guidelines. It should include information about the location of the Contents of the Cisco Systems ST373307LC, FAQ or common problems, i.e. places that are most often searched by users in each manual
2. Contents - index of all tips concerning the Cisco Systems ST373307LC, that we can find in the current document
3. Tips how to use the basic functions of the device Cisco Systems ST373307LC - which should help us in our first steps of using Cisco Systems ST373307LC
4. Troubleshooting - systematic sequence of activities that will help us diagnose and subsequently solve the most important problems with Cisco Systems ST373307LC
5. FAQ - Frequently Asked Questions
6. Contact detailsInformation about where to look for contact to the manufacturer/service of Cisco Systems ST373307LC in a specific country, if it was not possible to solve the problem on our own.

Do you have a question concerning Cisco Systems ST373307LC?

Use the form below

If you did not solve your problem by using a manual Cisco Systems ST373307LC, ask a question using the form below. If a user had a similar problem with Cisco Systems ST373307LC it is likely that he will want to share the way to solve it.

Copy the text from the picture

Comments (0)