Kubernetes NFS

K8s supports cinder but only working in ReadWriteOnce mode, which means if a pod associated with a cinder volume got migrated to other nodes, it will fail as nova will try to reattach a cinder volume to another nodes on openstack which is not supported. A workaround is to use NFS, luckily openstack has a native solution. NFS has another advantage which is it supports ReadWriteMany mode. It offers posibility for mutiple pods to associate with 1 pvc, which lead to advanced level of HA.

Continue reading

Kubernetes Storage

Storage Attaching volume is like attaching a disk onto VM or mounting a dev onto a folder. Frequent used functions of volume API are: local PV: can mount disk, partition or directory, e.g /mnt/disks/ssd1. hostpath: can only mount local host directory. emptyDir: non-existed space, can be used as shared disk between 2 container in 1 pod. PVC: a way to claim durable storage without knowing the details of the cloud environment.

Continue reading

iSCSI on MDS

一篇很棒的BLOG。CISCO关于iSCSI的指导MDS在iSCSI中扮演一个中介角色,它一端通过FC连接STORAGE,一端通过GI口连接SERVER。在FC看来,它在和SERVER的PWWN相连(其实是MDS给的假PWWN),从SERVER端看来,它在连一个ISCSI TARGET IP或IQN。 iSCSI和ISLB的很大区别是,iSCSI initiator命令只用作修改VSAN和CHAP,而TARGET需要另外用iscsi virtual-target命令定义。islb是把这两个合并到islb initiator命令中使用。同时islb virtual-target提供更多的详细control access。在MDS没有配置任何iSCSI initiator的情况下,如果有SERVER前来连接MDS,MDS会根据iSCSI口上是否启用动态分配PWWN功能做成反应。如果开启,就会自动分配地址。 int iscsi 1/2 no shut switchport proxy-initiator 这句可有可无,PROXY的作用是将多个FLOGI和FCID合并为一个 vsan database vsan 101 interface iscsi 1/2 将新iSCSI口分配给VSAN101,后面才能和其他VSAN101中的FC上的PWWN归为一个ZONE iscsi import target fc 将FC上连的所有PWWN对象都引入为自动创建的iSCSI TARGET zoneset name VSAN101 vsan 101 zone name ESXi-JBOD1-D2 member pwwn 21:00:00:1d:38:1c:6f:24 FC上的STORAGE PWWN member ip-address 10.150.150.10 SERVER端IP地址 member pwwn 21:0a:00:0d:ec:54:63:82 MDS为iSCSI 1/2自动生成的PWWN,在STORAGE看来它就是SERVER端的PWWN member symbolic-nodename iqn.1998-01.com.vmware:53de1d20-106c-8c14-070d-0025b500010d-612838b7 SERVER端IQN zoneset activate name VSAN101 vsan 101 iscsi save-initiator 将系统自动分配的动态SERVER PWWN存为固态PWWN,防止重启后PWWN改变 ====================================================================================== 以上是动态分配的配置方法,下面介绍固态 iscsi import target fc会自动将所有连入MDS的IQN请求关联,如果想针对某一TARGET IQN的连接进行限制,就要针对TARGET建立可以访问的表格 UCS BOOT from iSCSI是需要写TARGET IQN,就会用到这个

Continue reading

Nexus 5k FC Storage

将5k类具有UP功能的NEXUS变成FC口的方法如下: 将E1/45-48变成FC口,此命令执行完需要重启! slot 1 port 45-48 type fc 定义VSAN,和接口指定为ACCESS的VSAN号 vsan database vsan 1000 vsan 1000 interface fc1/48 定义VSAN的VLAN vlan 1000 fcoe vsan 1000 name fcoe_test 定义FC口为F口,因为对面连接FI,FI的VHBA对外是一个开启NPV功能的FC交换机,而5K是FI和STORAGE间的中转,所以需要5K开启NPIV来帮助解答NPV数据,在这种关系中,5k对外的口是F,FI上的口是NP。 interface fc1/48 switchport mode F FEATURE FCOE如果不开启,重启后的NEXUS就看不到新配的FC口,配置文件都在,只是看不到口,需要FCOE license。 5596Top(config)# feature fcoe FC license checked out successfully fc_plugin extracted successfully FC plugin loaded successfully FCoE manager enabled successfully FC enabled on all modules successfully Enabled FCoE QoS policies successfully 如果一切正常就会在5K上看到UCS上的vhba: 5596Top(config)# sh flogi database fc1/48 1000 0xd20040 20:30:8c:60:4f:5b:2b:80 23:e8:8c:60:4f:5b:2b:81 fc1/48 1000 0xd20041 20:00:00:25:b5:ff:06:8f 20:00:00:25:b5:ff:02:8f fc1/48 1000 0xd20042 20:00:00:25:b5:ff:06:9f 20:00:00:25:b5:ff:02:9f fc1/48 1000 0xd20043 20:00:00:25:b5:ff:06:6f 20:00:00:25:b5:ff:02:6f fc1/48 1000 0xd20044 20:00:00:25:b5:ff:06:4f 20:00:00:25:b5:ff:02:4f fc1/48 1000 0xd20045 20:00:00:25:b5:ff:06:7f 20:00:00:25:b5:ff:02:7f fc1/48 1000 0xd20046 20:00:00:25:b5:ff:06:5f 20:00:00:25:b5:ff:02:5f fc1/48 1000 0xd20047 20:00:00:25:b5:ff:06:2f 20:00:00:25:b5:ff:02:2f fc1/48 1000 0xd20048 20:00:00:25:b5:ff:06:3f 20:00:00:25:b5:ff:02:3f

Continue reading

U_Port (Universal) - Port on the switch when booting wait for something plugged into the port. G_Port (General Purpose Port) - Port on the switch that auto configures itself once the attached node logs in to the fabric. The node may be any N-Port such as an HBA (F_Port) or another switch (E_Port). FL_Port (Fabric Loop Port) - Disk array that supports Fabric (public) addressing and relies on arbitrated loop services.

Continue reading

Storage

RAID 0: 无分组,无备份。 RAID 1: mirror备份,数据:备份 = 1:1。 RAID 4: 专门划出一个盘存放备份数据checksum。 RAID 5: 每个数据盘分出一部分空间存放备份数据checksum,以便数据丢失时利用已知数据和checksum算出丢失部分,重新恢复。 RAID 1 0: 每个数据盘一个备份数据,将所有raid1加起来无分组无备份集联就是RAID10。 LUN:RAID组中分割出来的一段逻辑空间。这种空间会跨越多个RAID组中的物理磁盘。 WWN:World Wide Name 同MAC。 WWN分为: WWNN:Node的WWN; WWPN:Node上接口的WWN; WWFN:每个MDS的SW口上都有自己的WWN; WWSN:每个MDS交换机有一个WWN。 Zone:光交换中的区概念同Vlan。 FC和ETHERNET的比较:L1: ETHERNET | FCL2: MAC | WWNL3: IP | FCIPMAC learning | FLOGIiSNS:Internet Storage Name Service:可有可无。

Continue reading

存储系统都挺贵的,就算搭建一套二手设备组成的SAN存储环境,至少都得1万块。好在各大存储设备厂商都有自己的存储模拟器,EMC、IBM、NetApp都有,练下手还是可以的。 EMC存储系统的配置管理工具主要有2种,老的Navisphere和新的Unisphere,花了半天时间终于在EMC站点上找到了它们。 它们的下载地址是: EMC Celerra Simulator with Uniphere Management Tool (Unisphere模拟器,是一个Vmware的Linux虚拟机,仿真程度较高) https://community.emc.com/community/edn点击下面的画圈处下载: 接下来选择下面的链接 下载速度还是挺快的: EMC Celerra Simulator Installation and Configuration Guide (Unisphere模拟器的安装与配置指南) https://community.emc.com/servlet/JiveServlet/previewBody/4747-102-2-16972/Celerra_Simulator_Install_Config_Guide_300-003-555_a06.pdfEMC Navisphere and CLARiiON CX Hardware Simulator(Navisphere模拟器,以及CLARiiON CX硬件模拟器,前者是一个108MB的教学软件,后者只是让你熟悉一下CLARiiON CX硬件的一组FLASH小玩意) http://education.emc.com/ISMbook/resources_content.aspx点击下面的画圈处下载: EMC Navisphere Simulator Lab Manual (Navisphere模拟器的实验手册,下载上面的Navisphere模拟器时,压缩包里也自带了实验手册) https://developer-content.emc.com/downloads/jive_attach_proxy.htm?ecnCommID=2369&ecnCommName=Unified Storage&ecnAttachmentName=VNX Simulator Installation & Configuration Guide.pdf&ecnContainerURL=/docs/DOC-4092&reqURL=/servlet/JiveServlet/download/4092-10-31575/VNX Simulator Installation & Configuration Guide.pdf注:下载时会提示输入ECN帐号,随便注册一下(免费)即可。Unisphere虚拟机下载完后,打开配置指南 可以看到运行配置要求还是挺高的: .x64 CPU .x64 OS (我的本本是Win 7 x64) .内存要占用4GB(我的本本是8GB) .硬盘剩余空间40GB (运行虚拟机时我看到了吃掉了37.5GB的硬盘空间,得准备足够的容量) 虚拟机自带的配置 启动Unisphere模拟器虚拟机,root帐号密码是nasadmin (硬件是Celerra NAS系统) 接下来按手册配置一下网卡,以便让你的电脑和虚拟机通信 从电脑上(要事件安装好JRE)打开浏览器,输入虚拟机的eth0地址,Unisphere登录的帐号是nasadmin,口令nasadmin Unisphere,哈哈! 在左边点击自带的监视工具Celerra Monitor 总视图 系统日志界面: 磁盘监控界面 内存及CPU监控界面 Navisphere模拟器安装很简单(可惜我发现我的Win7 x64不能顺利安装,只好装在一个WINXP虚拟机中),接下来看一看Navisphere界面 压缩包里自带的实验手册

Continue reading

Author's picture

LuLU

Love coding and new technologies

Cloud Solution Consultant

Canada