Bug 128978

Summary:	[install] FreeBSD 6.3 64-bit panics at boot time during installation on HP DL580 G5 with 128GB physical memory
Product:	Base System	Reporter:	Kumar Krishnamoorthy <kumark>
Component:	amd64	Assignee:	freebsd-amd64 (Nobody) <amd64>
Status:	Closed FIXED
Severity:	Affects Only Me
Priority:	Normal
Version:	Unspecified
Hardware:	Any
OS:	Any

Description Kumar Krishnamoorthy 2008-11-19 01:00:14 UTC

When I try to install freeBSD-64 6.3 GA on a system with 128GB physical memory, it reports  kmem_suballoc : bad status retirn of 3
panic : kmem_suballoc 

When I read the faq from freebsd site, it mentions that the 64-bit version would support systems upto 1TB of physical memory.

Server used 
-----------
Server Model              : HP ProLoant DL580 G5 
Physical memory installed : 128 GB Installed
ProLiant System BIOS      : P61 (08/08/2007)
CPU                       : 
Proc 1: Quad-Core Intel(R) Xeon(TM) Processor (2.40 GHz/1066 MHz, 2x4MB L2)
Proc 2: Quad-Core Intel(R) Xeon(TM) Processor (2.40 GHz/1066 MHz, 2x4MB L2)
Proc 3: Quad-Core Intel(R) Xeon(TM) Processor (2.40 GHz/1066 MHz, 2x4MB L2)
Proc 4: Quad-Core Intel(R) Xeon(TM) Processor (2.40 GHz/1066 MHz, 2x4MB L2)

Failure details.
-----------------
ISO used for installation
6.3-RELEASE-amd64-disc1.iso
.
.
Attempting Boot From CD-ROM
CD Loader 1.2

Building the boot loader arguments
Looking up /BOOT/LOADER... Found
Relocating the loader and the BTX
Starting the BTX loader


Consoles: internal video/keyboard
BIOS CD is cd0
BIOS drive A: is disk0
BIOS drive C: is disk1
BIOS 637kB/3404056kB available memory

FreeBSD/i386 bootstrap loader, Revision 1.1
(root@palmer.cse.buffalo.edu, Tue Jan 15 23:20:25 UTC 2008)
Loading /boot/defaults/loader.conf
/boot/kernel/kernel text=0x6b30f8 syms=[0x8+0xa10a0+0x8+0x8
8855]


+-----------------------------------------+
 |                                         |
 |                                         |      ______
 |                                         |     |  ____| __ ___  ___
 |          Welcome to FreeBSD!            |     | |__ | '__/ _ \/ _ \
 |                                         |     |  __|| | |  __/  __/
 |                                         |     | |   | | |    |    |
 |  1. Boot FreeBSD [default]              |     |_|   |_|  \___|\___|
 |  2. Boot FreeBSD with ACPI disabled     |      ____   _____ _____
 |  3. Boot FreeBSD in Safe Mode           |     |  _ \ / ____|  __ \
 |  4. Boot FreeBSD in single user mode    |     | |_) | (___ | |  | |
 |  5. Boot FreeBSD with verbose logging   |     |  _ < \___ \| |  | |
 |  6. Escape to loader prompt             |     | |_) |____) | |__| |
 |  7. Reboot                              |     |     |      |      |
 |                                         |     |____/|_____/|_____/
 |                                         |
 |                                         |
 |                                         |
 |  Select option, [Enter] for default     |
 |  or [Space] to pause timer  8           |
 +-----------------------------------------+


FreeBSD 6.3-RELEASE #0: Wed Jan 16 01:31:10 UTC 2008
  root@palmet.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC
kmem_suballoc : bad status retirn of 3
panic : kmem_suballoc
Uptime: 1s




Note : I tried the following things.
a) freeBSD7.0-64 did not panic while installation
b) freeBSD6.3-64 could boot without any problems till 90GB memory on a virtual machine created on ESX40 



Let me know if you need more details for debugging.

How-To-Repeat: Try to install freeBSD6.3-64 on a physical machine with 128GB of physical memory

Comment 1 Gavin Atkinson freebsd_committer

2008-11-21 11:47:42 UTC

State Changed
From-To: open->feedback

To submitter: are you able to boot using the "verbose logging" option 
from the menu and show any additional messages you see?  I'm especially 
interested in any lines beginning with SMAP. 

Can I just confirm that 7.0 works fine on this machine?

Comment 2 Kumar Krishnamoorthy 2008-12-07 08:50:55 UTC

This is from freeBSD6.4 64 GA
SMAP type=01 base=0000000000000000   len 000000000009f800
SMAP type=02 base=000000000009f800    len 0000000000000800
SMAP type=02 base=00000000000ca000   len 0000000000002000
SMAP type=02 base=00000000000dc000   len 0000000000004000
SMAP type=02 base=00000000000e4000   len 000000000001c000
SMAP type=01 base=0000000000100000   len 00000000bfdf0000
SMAP type=03 base=00000000bfef0000     len 000000000000f000
SMAP type=04 base=00000000bfeff000      len 0000000000001000
SMAP type=01 base=00000000bff00000     len 0000000000100000
SMAP type=02 base=00000000e0000000   len 0000000010000000
SMAP type=02 base=00000000fec00000    len 0000000000010000
SMAP type=02 base=00000000fee00000    len 0000000000001000
SMAP type=02 base=00000000fffe0000      len 0000000000020000
SMAP type=01 base=0000000100000000   len 0000001f40000000

I could not reproduce this on freeBSD7.0 GA. It boots well without any issues.

-Kumar

Comment 3 Kumar Krishnamoorthy 2008-12-08 07:50:40 UTC

--_000_7A7D327E99D30143AC98BDABFCABFF012271549D98PAEXMBX04vmwa_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

I could see the failure on all freebsd6.x-64 with more than 64GB of memory.=
  I ran this test on virtual machine that was created on the same HP DL580 =
G5 server with 128GB server.
Failures
  7 FAIL Duration=3D15m29s guestOS=3Dfreebsd6.2-64           memSize=3D1310=
72
  8 FAIL Duration=3D15m35s guestOS=3Dfreebsd6.3-64           memSize=3D1310=
72
  9 FAIL Duration=3D15m33s guestOS=3Dfreebsd6.4-beta1-64 memSize=3D131072
 10 FAIL Duration=3D15m32s guestOS=3Dfreebsd6.4-rc1-64    memSize=3D131072
 11 FAIL Duration=3D15m32s guestOS=3Dfreebsd6.4-rc2-64    memSize=3D131072
Passed
  0 PASS Duration=3D46m53s guestOS=3Dfreebsd6.2-64          memSize=3D65536
  1 PASS Duration=3D52m48s guestOS=3Dfreebsd6.3-64          memSize=3D65536
  3 PASS Duration=3D23m14s guestOS=3Dfreebsd6.4-rc1-64    memSize=3D65536
  4 PASS Duration=3D23m20s guestOS=3Dfreebsd6.4-rc2-64    memSize=3D65536 .=
.
memSize - Guest memory that was used for the test in MB.
Duration  -  Time it tool to install the guestOS.

Comment 4 Gavin Atkinson freebsd_committer

2009-08-27 15:51:32 UTC

State Changed
From-To: feedback->open

Feedback was received on this some time ago.  Although FreeBSD 7 is happy 
with 128G RAM, FreeBSD 6.x cannot boot.  I don't know if setting something like 
'options KVA_PAGES=512' in the kernel may help?  It might be worth trying.

Comment 5 Andriy Gapon freebsd_committer

2010-12-05 11:46:40 UTC

State Changed
From-To: open->closed

6.4 and the whole 6 branch has been EoL-ed, so I guess 
there will be no fixing there.