Comments on: Setting Up FCoE on a Nexus 5000

By: Marc

Marc — Thu, 02 Feb 2012 14:40:20 +0000

Hi Scott,
I think on the Nexus 5548 and 5596 Plattform you also need to adjust QoS for FCoE. Because with the enable the feature fcoe, the Nexus will create the new service-policy, but not activate them:

n5548(config)# system qos
n5548(config)# service-policy type qos input fcoe-default-in-policy
n5548(config)# service-policy type network-qos fcoe-default-nq-policy
n5548(config)# service-policy type queuing input fcoe-default-in-policy
n5548(config)# service-policy type queuing output fcoe-default-out-policy

Is that correct?
Thanks a lot

By: Burak

Burak — Fri, 27 Jan 2012 14:59:41 +0000

Hi Scott,

I did the configuration between Nexus 5548UP and C-200 with P81E VIC. But i discovered that when the VIC finds and brings up the OS from my FC Storage after the loading of Operating System the flogi database is disappears from N5548UP. And also my C200 can use the ESXi OS but cannot see the datastores. There is no such a problem like this with my FIs and Blades. But i think i’m missing something on the N5548UP or on the VIC.

Do you have any advises for me?

Thank you.

By: slowe

slowe — Wed, 23 Nov 2011 19:29:16 +0000

Milena, thanks for the recommendation. I also generally recommend staying away from the use of VLAN 1 and VSAN 1 and using other VLANs and VSANs in your configurations.

By: Milena

Milena — Wed, 23 Nov 2011 17:44:31 +0000

VLAN 1 will be used for negotiation, I would strongly suggest to use some other VLAN to map VSAN and on trunk allow VSAN Vlan, data vlans and VLAN 1.

By: Isaac Chehab

Isaac Chehab — Thu, 27 Oct 2011 21:37:29 +0000

Hi…

I just figured out my problem…. its just not supported to get the ucs 6120 (blades) vhba through the fcoe on the nexus 5000…. the only way to do it is trough the fc uplinks on the expansion fc module. The nexus 5000 is not the problem, it supports it if fc is traveling through the fcoe link but in the case of ucs 6120 the only way to send fc data from the ucs 6120 to the nexus 5000 is through the fc expansion module of the ucs 6120.

Thanks

By: slowe

slowe — Thu, 27 Oct 2011 17:10:16 +0000

Isaac, I’m traveling at the moment and I’d really need to sit down and take a closer, more focused look at what you’re trying to accomplish. However, at first glance, try not setting vfc4 to a trunk with a specific allowed VSAN. Also, you didn’t mention what VLAN your management port is using, and you didn’t mention how connectivity to the management port is managed. Any additional information you can provide might be useful.

By: Isaac Chehab

Isaac Chehab — Thu, 27 Oct 2011 15:34:35 +0000

Ok… sorry.. ill explain it better…:

I am trying to connect some cisco blades to a netapp storage trough a nexus 5000.

I have 2 cisco UCS fabric 6120 connected via fcoe to a nexus 5000 in ports:

Ethernet 1/1 = Fabric UCS 6120 1
Ethernet 1/2 = Fabric UCS 6120 2

And to the ucs 6120 i have connected a cisco blade system with 2 b200

A fiber cable connected to a expansion module on the nexus 5000 to port and on the other end a netapp:

FC 2/2 = Netapp

………………………

Im following this guide doing this

vsan database
vsan 10

vlan 2
fcoe vsan 10
no shutdown

interface vfc4
bind interface Ethernet 1/2
switchport trunk allowed vsan 10
no shutdown

vsan database
vsan 10 interface vfc4
…………………………………………………

the problem is that as soon as i put the command
vlan 2
fcoe vsan 10

i loose conectivity to the blade servers and the conection to the management port on the nexus 5000 starts flapping…. i have enabled the features fcoe and npiv…. Im not talking about zonning cause i cant even get to that point cause i lose conection.

thanks

By: slowe

slowe — Thu, 27 Oct 2011 03:05:26 +0000

Isaac, we’re going to need a bit more detail than just a couple of commands taken out of context. Can you shed a bit more light on the problem and what you’re trying to accomplish?

By: Isaac Chehab

Isaac Chehab — Thu, 27 Oct 2011 00:46:31 +0000

when y put
vlan 1
fcoe vsan 10

the conectivity between my ucs blade servers and the nexus hangs also the nexus 5000 stops responding.

anyone??? some help??

thanks in advance

By: Mark Penzien

Mark Penzien — Fri, 30 Sep 2011 18:31:21 +0000

Thanks for this post! SAN fabric management is new to me and I’m attempting to help deploy a pair of Nexus 5000′s with NetApps. This has helped me get a better start!

Because FCoE is new to me, I did a lot of googling. Thought you should know that this post was lifted by another blogger at http://www.druid.co.il/wordpress/?p=133