Exadata X5-2服务器上扩内存或者更换内存的paper研究

联系:QQ(5163721)

标题:Exadata X5-2服务器上扩内存或者更换内存的paper研究

作者:Lunar©版权所有[文章允许转载,但必须以链接方式注明源地址,否则追究法律责任.]

根据Oracle白皮书的记录,Oracle Sun Server X5-2数据库服务器的配置如下:

X5-2 with Oracle Sun Server X5-2 Oracle Database Server:
Each database server is a component of the larger Machine and consists of the following major components:
		2 Intel Xeon E5-2699 18-Core processors (2.3GHz)
		256GB DDR4-2133 RAM (8x 32GB DIMMS; Memory Expansion kit provides up to 24x 32GB DIMMS in groups of 8)
		4x 600GB 10K RPM SAS2 disks pre-configured into a RAID5 volume with Linux and OVM pre-installed (choice made at install; dual-boot OS is not supported)
		Disk controller SAS3 HBA with 1GB write cache backed by ESM (LSI Aspen)
		Dual-port QDR (40Gb/s) InfiniBand Host Channel Adapter (HCA) PCIe Gen3 (qMirage CX3) supports Active/Active ports
		Dual-port 10 Gigabit Ethernet SFP+ ports (Intel Niantic)
		4 embedded 10 Gigabit Ethernet ports (copper) (1 is reserved for 1GbE management)
		1 Ethernet port for Sun Integrated Lights Out Manager (ILOM) for remote management
		Oracle Enterprise Linux pre-installed

注意上面:
256GB DDR4-2133 RAM (8x 32GB DIMMS; Memory Expansion kit provides up to 24x 32GB DIMMS in groups of 8)
也就是每台数据库服务器出厂缺省配置是256GB内存(8个32GB DIMM,具体型号是 DDR4-2133 RAM),可以扩展到最大24*32=768GB
LRDIMM是较新一代的内存设备,能够保证即使在单条内存32GB容量甚至更高的情况下,服务器上每个内存通道依然能够布满至3条内存条
这里的8组(P0:CHA,CHB,CHC,CHD P1:CHA,CHB,CHC,CHD),也就是每组上面可以最多插入3根内存条,因此一共可插入24跟内存条,每个内存条32GB
具体如下图:


1


在服务器上如何查看当前内存的使用情况呢:
当前已经插入的内存条有8根,每根都是32GB:32*8=256GB

[root@dm01db01 ~]# dmidecode -t memory|grep "Size: 32 GB"
        Size: 32 GB
        Size: 32 GB
        Size: 32 GB
        Size: 32 GB
        Size: 32 GB
        Size: 32 GB
        Size: 32 GB
        Size: 32 GB
[root@dm01db01 ~]# 

服务器上每个CPU支持的一对内存模块最多内存容量为192GB(6*32GB):

[root@dm01db01 ~]# dmidecode -t memory|grep Maximum|sort|uniq
        Maximum Capacity: 192 GB
[root@dm01db01 ~]# 

服务器上每个CPU支持的一对内存模块最多内存插槽为6个:

[root@dm01db01 ~]# dmidecode -t memory|grep Number|sort|uniq
        Number Of Devices: 6
        Part Number: M386A4G40DM0-CPB   
        Part Number: NO DIMM
        Serial Number: 02718F69
        Serial Number: 027190B4
        Serial Number: 02719149
        Serial Number: 02719157
        Serial Number: 02719160
        Serial Number: 027AA606
        Serial Number: 027AA60D
        Serial Number: 027AA611
        Serial Number: NO DIMM
[root@dm01db01 ~]# 

24*32=768GB,也就是当前系统最大可以插入24根32GB的内存条,也就是最多支持768GB内存:

[root@dm01db01 ~]# dmidecode -t memory|grep "Memory Device"|wc -l
24
[root@dm01db01 ~]# 

内存频率是2133:

[root@dm01db01 ~]# dmidecode -t memory|grep Speed|sort|uniq
        Configured Clock Speed: 2133 MHz
        Configured Clock Speed: Unknown
        Speed: 2133 MHz
        Speed: Unknown
[root@dm01db01 ~]# 

全部内存信息如下:

[root@dm01db01 ~]# dmidecode -t memory
# dmidecode 2.12
SMBIOS 2.8 present.

Handle 0x0031, DMI type 16, 23 bytes
Physical Memory Array
        Location: System Board Or Motherboard
        Use: System Memory
        Error Correction Type: Multi-bit ECC
        Maximum Capacity: 192 GB      ------------------说明参见下面
        Error Information Handle: Not Provided
        Number Of Devices: 6     -----------说明参见下面
        
还是对比着上面的图,这里面我们计算一下:
LRDIMM是较新一代的内存设备,能够保证即使在单条内存32GB容量甚至更高的情况下,服务器上每个内存通道依然能够布满至3条内存条
.
X5-2数据库服务器一共两个物理CPU,每颗CPU左右两侧各有2组内存模块(每组模块上可以最多插入3个内存条),共8组内存模块
每个CPU支持的一对内存模块,每个模块可以最多插入3根内存条,因此每个CPU支持最多插槽数为6,因此,每个CPU支持最多6*32GB=192GB
.
一共应该有8个内存模块(P0:CHA,CHB,CHC,CHD   P1:CHA,CHB,CHC,CHD),每个内存模块上可以插入3根内存条
因此总共可以插入24根内存条(参见上面的“dmidecode -t memory|grep "Memory Device"|wc -l”)
且服务器最大支持24*32DB=768GB内存
.
															
当前已经插入的内存条,32GB:					
Handle 0x0033, DMI type 17, 34 bytes
Memory Device
        Array Handle: 0x0031
        Error Information Handle: Not Provided
        Total Width: 72 bits
        Data Width: 64 bits
        Size: 32 GB          -------------当前已经插入的内存条,32GB
        Form Factor: DIMM
        Set: None
        Locator: D11
        Bank Locator: SYS/MB/P0
        Type: Other
        Type Detail: Synchronous
        Speed: 2133 MHz
        Manufacturer: Samsung
        Serial Number: 02719157
        Asset Tag: DIMM_A1_AssetTag
        Part Number: M386A4G40DM0-CPB   
        Rank: 4
        Configured Clock Speed: 2133 MHz
        
没插入内存条的空槽信息如下:
Handle 0x0044, DMI type 17, 34 bytes
Memory Device
        Array Handle: 0x003B
        Error Information Handle: Not Provided
        Total Width: Unknown
        Data Width: Unknown
        Size: No Module Installed         -------------当前空着的槽位
        Form Factor: DIMM
        Set: None
        Locator: D5
        Bank Locator: SYS/MB/P0
        Type: Other
        Type Detail: Synchronous
        Speed: Unknown
        Manufacturer: NO DIMM
        Serial Number: NO DIMM
        Asset Tag: NO DIMM
        Part Number: NO DIMM
        Rank: Unknown
        Configured Clock Speed: Unknown

。。。。。。。。。。。。
类似信息不赘述了

具体更换步骤参见 《Oracle Exadata Database Machine Maintenance Guide》
Adding Memory Expansion Kit to Database Servers

Exadata X5-2服务器上扩内存或者更换内存的详细步骤

此条目发表在 安装和升级 分类目录,贴了 , , 标签。将固定链接加入收藏夹。

发表评论

电子邮件地址不会被公开。 必填项已用 * 标注

您可以使用这些 HTML 标签和属性: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>