Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Why is my 4TB drive only 2TB?
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Unsupported Software
View previous topic :: View next topic  
Author Message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 7:13 am    Post subject: Why is my 4TB drive only 2TB? Reply with quote

why does the kernel see my disk as 2tb when it’s actually 4?

Code:
[   15.749136] sd 0:0:1:0: [sdb] 4294967294 512-byte logical blocks: (2.20 TB/2.00 TiB)


and

Code:
Disk /dev/sdb: 4294967294 sectors, 2.0 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): D4448122-5FF7-4FCF-B8A0-36550CF494FB
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 4294967260
Partitions will be aligned on 2048-sector boundaries
Total free space is 4294967227 sectors (2.0 TiB)


But...

Code:
smartctl -i /dev/sdb
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.10.8-gentoo] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     HGST MegaScale 4000
Device Model:     HGST HMS5C4040ALE640
Serial Number:    PL1331LAG9R6WH
LU WWN Device Id: 5 000cca 22ec46ac2
Firmware Version: MPAOA3W0
User Capacity:    4,000,787,030,016 bytes [4.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5700 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 1.5 Gb/s)
Local Time is:    Sat Apr 15 03:09:39 2017 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
Back to top
View user's profile Send private message
Akkara
Administrator
Administrator


Joined: 28 Mar 2006
Posts: 6702
Location: &akkara

PostPosted: Sat Apr 15, 2017 8:35 am    Post subject: Reply with quote

Quote:
Disk /dev/sdb: 4294967294 sectors, 2.0 TiB

That number is 2**32 - 2. Suspiciously close to a 32-bit boundary. Are you using MBR partitioning? I think that one limits it.

Need to partition it as GPT for > 2TB, if I recall.
_________________
Many think that Dilbert is a comic. Unfortunately it is a documentary.
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sat Apr 15, 2017 8:52 am    Post subject: Reply with quote

mauricev,

Does your kernel support GPT partition tables?
As Akkara says, MSDOS partition tables break at 2.0TiB but when you make a GPT partition table you get a free protective MSDOS partition table too.
If the kernel does not support GPT partition tables, it sees and uses the MSDOS partition table.
Code:
$ grep EFI_PART  /usr/src/linux/.config
CONFIG_EFI_PARTITION=y

_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 8:30 pm    Post subject: Reply with quote

Something weird must be afoot, for

Code:
grep EFI_PART  /usr/src/linux/.config
CONFIG_EFI_PARTITION=y


and

Code:
Found valid GPT with protective MBR; using GPT.

Command (? for help): p
Disk /dev/sdb: 4294967294 sectors, 2.0 TiB


8O
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sat Apr 15, 2017 8:41 pm    Post subject: Reply with quote

mauricev,

Please post both your partition tables.
Code:
$ sudo /sbin/fdisk -l -t dos /dev/sdb
$ sudo /sbin/fdisk -l -t gpt /dev/sdb

_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 8:45 pm    Post subject: Reply with quote

Code:
sudo /sbin/fdisk -l -t dos /dev/sdb
Disk /dev/sdb: 2 TiB, 2199023254528 bytes, 4294967294 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x00000000

Device     Boot Start        End    Sectors Size Id Type
/dev/sdb1           1 4294967293 4294967293   2T ee GPT

sudo /sbin/fdisk -l -t gpt /dev/sdb
Disk /dev/sdb: 2 TiB, 2199023254528 bytes, 4294967294 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: gpt
Disk identifier: 1D4A636E-607D-884F-A899-F2E4B72F1BB3
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sat Apr 15, 2017 8:49 pm    Post subject: Reply with quote

mauricev,

Please post your emerge --info.

There must have been more in your -t dos partition table?

Code:
Disk /dev/sda: 1.8 TiB, 2000398934016 bytes, 3907029168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: dos
Disk identifier: 0x00000000

Device     Boot Start        End    Sectors  Size Id Type
/dev/sda1  *        1 3907029167 3907029167  1.8T ee GPT

That partition table entry is important.

Do you really have no partitions defined?
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 8:53 pm    Post subject: Reply with quote

Check my message again. I originally left out a line.

Code:
emerge --info
Portage 2.3.2 (python 3.4.6-final-0, funtoo/1.0/linux-gnu/arch/x86-64bit, gcc-4.9.3, glibc-2.23-r3, 4.10.8-gentoo x86_64)
=================================================================
System uname: Linux-4.10.8-gentoo-x86_64-Six-Core_AMD_Opteron-tm-_Processor_2435-with-gentoo-2.2.1
KiB Mem:     8185196 total,   6805320 free
KiB Swap:          0 total,         0 free
sh bash 4.3_p48
ld GNU ld (Gentoo 2.24 p1.4) 2.24
app-shells/bash:          4.3_p48::gentoo
dev-lang/perl:            5.24.0-r2::gentoo
dev-lang/python:          2.7.13::gentoo, 3.4.6::gentoo
sys-apps/baselayout:      2.2.1::gentoo
sys-apps/openrc:          0.23.2::gentoo
sys-apps/sandbox:         2.10-r3::gentoo
sys-devel/autoconf:       2.69-r2::gentoo
sys-devel/automake:       1.13.4::gentoo, 1.14.1-r1::gentoo, 1.15-r2::gentoo
sys-devel/binutils:       2.24-r3::gentoo, 2.25-r2::gentoo
sys-devel/gcc:            4.6.4-r2::gentoo, 4.8.4::gentoo, 4.9.3-r3::gentoo, 5.3.0-r1::gentoo
sys-devel/gcc-config:     1.8-r1::gentoo
sys-devel/libtool:        2.4.6-r3::gentoo
sys-devel/make:           4.1-r1::gentoo
sys-kernel/linux-headers: 4.9::gentoo (virtual/os-headers)
sys-libs/glibc:           2.23-r3::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: git
    sync-uri: git://github.com/funtoo/ports-2012.git
    priority: -1000

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="* -@EULA Oracle-BCLA-JavaSE"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-mtune=generic -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.1/ext-active/ /etc/php/cgi-php7.1/ext-active/ /etc/php/cli-php7.1/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-mtune=generic -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS=""
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--sort-common -Wl,--as-needed"
LINGUAS="en"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_TMPDIR="/var/tmp"
USE="amd64 bzip2 cracklib cxx iconv icu lm_sensors mmx modules mudflap multilib ncurses nls nptl openmp pcre readline resolvconf sse sse2 ssl unicode xattr xml zlib" ABI_X86="64" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias authn_core authz_core socache_shmcb proxy proxy_fcgi unixd" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="evdev synaptics keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_4" QEMU_SOFTMMU_TARGETS="i386 x86_64" QEMU_USER_TARGETS="i386 x86_64" RUBY_TARGETS="ruby21 ruby22 ruby23 ruby24" USERLAND="GNU" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 9:02 pm    Post subject: Reply with quote

Could it be that the disk is advanced format and that BIOS of the computer doesn't understand how to read it?
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 9:20 pm    Post subject: Reply with quote

I put the disk in another, newer computer and got this

Code:
sudo /sbin/fdisk -l -t dos /dev/sdb
Disk /dev/sdb: 3.7 TiB, 4000787030016 bytes, 7814037168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes


It seems the older computer doesn't understand advanced format disks. :(
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sat Apr 15, 2017 9:44 pm    Post subject: Reply with quote

mauricev,

Ah ... Funtoo
Code:
funtoo/1.0/linux-gnu/arch/x86-64bit


Its not a BIOS problem, the kernel will not use the BIOS. BIOS problems related to HDD size show up as the HDD appearing to be 137GB to the BIOS or the BIOS hanging with the drive connected. Once you are past the BIOS, the kernel sees the whole drive.

I was wondering if it was a 32 bit install related issue. I cant rule that out as I don't know what your funtoo/1.0/linux-gnu/arch/x86-64bit does.
A 32 bit userland on top of a 64 bit kernel is possible.

Its like your kernel is reading the LBA32 field in the Identify command response from the drive instead of the LBA48 field.
The LBA32 field is only 32 bits, and can only report up to 2TiB.

How is the drive attached to your system?
Code:
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 1.5 Gb/s)
That's a SATA 1 port.
If the drive is in a USB enclosure, it may well be that the USB/SATA conversion does not transmit the LBA48 information.
A lot of USB to SATA convertors do not pass through low level commands and responses correctly.

Moved to Unsupported Software as Funtoo is not Gentoo.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 9:49 pm    Post subject: Reply with quote

The two computers, the one where it worked and the one where it doesn't both use the same Funtoo OS. Both computers are direct-attached SATA. The one that doesn't work is an HP xw9400, which was built in 2006 and the one that does is an xw8600, which was built in 2008, at least I'm guessing that based on their respective manuals. The only difference is the computer.
Back to top
View user's profile Send private message
Jaglover
Watchman
Watchman


Joined: 29 May 2005
Posts: 7189
Location: Saint Amant, Acadiana

PostPosted: Sat Apr 15, 2017 9:56 pm    Post subject: Reply with quote

What if you boot something neutral, like systemrescuecd?
_________________
Please learn how to denote units correctly!
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sat Apr 15, 2017 10:00 pm    Post subject: Reply with quote

mauricev,

Please post the lspi output for both systems.
Are you moving the same drive between the two systems or are you using two different drives?

The entire dmesg output from a reboot to log in on the system with the problem may be interesting too.
Please put that on a pastebin as its far too big to fit into a post.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 10:27 pm    Post subject: Reply with quote

This is the same drive I'm moving between the computers.

The working computer sees the GPT header as being wrong. I created a new partition table on it, and now the non-working computer sees it as corrupt. I see this corruption on the systemrescuecd too!

Code:
Warning! Disk size is smaller than the main header indicates! Loading
secondary header from the last sector of the disk!


Code:
working system
00:00.0 Host bridge: Intel Corporation 5400 Chipset Memory Controller Hub (rev 20)
00:01.0 PCI bridge: Intel Corporation 5400 Chipset PCI Express Port 1 (rev 20)
00:03.0 PCI bridge: Intel Corporation 5400 Chipset PCI Express Port 3 (rev 20)
00:05.0 PCI bridge: Intel Corporation 5400 Chipset PCI Express Port 5 (rev 20)
00:09.0 PCI bridge: Intel Corporation 5400 Chipset PCI Express Port 9 (rev 20)
00:10.0 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
00:10.1 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
00:10.2 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
00:10.3 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
00:10.4 Host bridge: Intel Corporation 5400 Chipset FSB Registers (rev 20)
00:11.0 Host bridge: Intel Corporation 5400 Chipset CE/SF Registers (rev 20)
00:15.0 Host bridge: Intel Corporation 5400 Chipset FBD Registers (rev 20)
00:15.1 Host bridge: Intel Corporation 5400 Chipset FBD Registers (rev 20)
00:16.0 Host bridge: Intel Corporation 5400 Chipset FBD Registers (rev 20)
00:16.1 Host bridge: Intel Corporation 5400 Chipset FBD Registers (rev 20)
00:1b.0 Audio device: Intel Corporation 631xESB/632xESB High Definition Audio Controller (rev 09)
00:1c.0 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 1 (rev 09)
00:1c.1 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 2 (rev 09)
00:1d.0 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #1 (rev 09)
00:1d.1 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #2 (rev 09)
00:1d.2 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #3 (rev 09)
00:1d.3 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #4 (rev 09)
00:1d.7 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset EHCI USB2 Controller (rev 09)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d9)
00:1f.0 ISA bridge: Intel Corporation 631xESB/632xESB/3100 Chipset LPC Interface Controller (rev 09)
00:1f.1 IDE interface: Intel Corporation 631xESB/632xESB IDE Controller (rev 09)
00:1f.2 RAID bus controller: Intel Corporation 631xESB/632xESB SATA RAID Controller (rev 09)
01:05.0 FireWire (IEEE 1394): Texas Instruments TSB43AB22A IEEE-1394a-2000 Controller (PHY/Link) [iOHCI-Lynx]
0e:00.0 Ethernet controller: Broadcom Limited NetXtreme BCM5755 Gigabit Ethernet PCI Express (rev 02)
0f:00.0 Ethernet controller: Broadcom Limited NetXtreme BCM5755 Gigabit Ethernet PCI Express (rev 02)
10:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Upstream Port (rev 01)
10:00.3 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express to PCI-X Bridge (rev 01)
11:06.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068 PCI-X Fusion-MPT SAS (rev 02)
1e:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E1 (rev 01)
1e:01.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E2 (rev 01)
60:00.0 VGA compatible controller: NVIDIA Corporation G84GL [Quadro FX 570] (rev a1)


Code:
not working
0000:00:00.0 RAM memory: NVIDIA Corporation MCP55 Memory Controller (rev a2)
0000:00:01.0 ISA bridge: NVIDIA Corporation MCP55 LPC Bridge (rev a3)
0000:00:01.1 SMBus: NVIDIA Corporation MCP55 SMBus Controller (rev a3)
0000:00:02.0 USB controller: NVIDIA Corporation MCP55 USB Controller (rev a1)
0000:00:02.1 USB controller: NVIDIA Corporation MCP55 USB Controller (rev a2)
0000:00:04.0 IDE interface: NVIDIA Corporation MCP55 IDE (rev a1)
0000:00:05.0 IDE interface: NVIDIA Corporation MCP55 SATA Controller (rev a3)
0000:00:05.1 IDE interface: NVIDIA Corporation MCP55 SATA Controller (rev a3)
0000:00:05.2 IDE interface: NVIDIA Corporation MCP55 SATA Controller (rev a3)
0000:00:06.0 PCI bridge: NVIDIA Corporation MCP55 PCI bridge (rev a2)
0000:00:08.0 Bridge: NVIDIA Corporation MCP55 Ethernet (rev a3)
0000:00:09.0 Bridge: NVIDIA Corporation MCP55 Ethernet (rev a3)
0000:00:0d.0 PCI bridge: NVIDIA Corporation MCP55 PCI Express bridge (rev a3)
0000:00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor HyperTransport Configuration
0000:00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Address Map
0000:00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor DRAM Controller
0000:00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Miscellaneous Control
0000:00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Link Control
0000:01:05.0 FireWire (IEEE 1394): Texas Instruments TSB43AB22A IEEE-1394a-2000 Controller (PHY/Link) [iOHCI-Lynx]
0000:2b:00.0 PCI bridge: NEC Corporation uPD720400 PCI Express - PCI/PCI-X Bridge (rev 06)
0000:2b:00.1 PCI bridge: NEC Corporation uPD720400 PCI Express - PCI/PCI-X Bridge (rev 06)
0001:40:00.0 RAM memory: NVIDIA Corporation MCP55 Memory Controller (rev a2)
0001:40:01.0 RAM memory: NVIDIA Corporation MCP55 LPC Bridge (rev a3)
0001:40:01.1 SMBus: NVIDIA Corporation MCP55 SMBus Controller (rev a3)
0001:40:0a.0 PCI bridge: NVIDIA Corporation MCP55 PCI Express bridge (rev a3)
0001:40:0d.0 PCI bridge: NVIDIA Corporation MCP55 PCI Express bridge (rev a3)
0001:45:00.0 VGA compatible controller: NVIDIA Corporation GT218 [GeForce 210] (rev a2)
0001:45:00.1 Audio device: NVIDIA Corporation High Definition Audio Controller (rev a1)
0001:6b:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 08)


Working computer, dmesg, https://pastebin.com/ctT93MZr
Non-working computer dmesg, https://pastebin.com/t9sgdYVL
Back to top
View user's profile Send private message
Irre
Guru
Guru


Joined: 09 Nov 2013
Posts: 342
Location: Stockholm

PostPosted: Sat Apr 15, 2017 10:34 pm    Post subject: Reply with quote

I have an external 3TB dos formatted disk:
Code:
Disk /dev/sda: 2,7 TiB, 3000592977920 bytes, 732566645 sectors
Units: sectors of 1 * 4096 = 4096 bytes
Sector size (logical/physical): 4096 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: dos
Disk identifier: 0xde20267e

Device     Boot     Start       End   Sectors   Size Id Type
/dev/sda1            2048   2623487   2621440    10G 83 Linux
/dev/sda2  *      2623488 264767487 262144000  1000G 83 Linux
/dev/sda3       264767488 526911487 262144000  1000G 83 Linux
/dev/sda4       526911488 732565503 205654016 784,5G 83 Linux
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sat Apr 15, 2017 10:46 pm    Post subject: Reply with quote

mauricev,

Tell which interface you are using in the non working system and pastebin the kernel .config from that system.

Its quite clear from the dmesg that the GPT partition table was written on the system that only sees half the drive.
Code:
[    1.811623] GPT:Primary header thinks Alt. header is not at the end of the disk.
[    1.811672] GPT:4294967293 != 7814037167
[    1.811716] GPT:Alternate GPT header not at the end of the disk.
[    1.811763] GPT:4294967293 != 7814037167
[    1.811808] GPT: Use GNU Parted to correct GPT errors.

_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sat Apr 15, 2017 10:52 pm    Post subject: Reply with quote

Irre,

That works because of
Code:
Units: sectors of 1 * 4096 = 4096 bytes

It was trying to avoid saying that the 2TiB limit is for 512B sectors.
Its 16TiB for 4kB sectors.

Most drives fake 512B sectors even if they use 4kB physical sectors, so the lower limit applies.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sat Apr 15, 2017 11:01 pm    Post subject: Reply with quote

NeddySeagoon wrote:
mauricev,

Tell which interface you are using in the non working system

You mean SATA? I'm not quite sure what you mean by interface.

Quote:
and pastebin the kernel .config from that system.


Both systems use the same kernel
https://pastebin.com/MRNgDQGt
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sat Apr 15, 2017 11:23 pm    Post subject: Reply with quote

mauricev,

In the not working case, your kernel has
Code:
# CONFIG_SATA_NV is not set
which is the driver for the on board SATA interfaces
Code:
0000:00:05.0 IDE interface: NVIDIA Corporation MCP55 SATA Controller (rev a3)
0000:00:05.1 IDE interface: NVIDIA Corporation MCP55 SATA Controller (rev a3)
0000:00:05.2 IDE interface: NVIDIA Corporation MCP55 SATA Controller (rev a3)


It follows that the drive must be connected te the plug in card
Code:
0001:6b:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 08)


The working system has
Code:
11:06.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068 PCI-X Fusion-MPT SAS (rev 02)
which is a different card.
It also has
Code:
00:1f.2 RAID bus controller: Intel Corporation 631xESB/632xESB SATA RAID Controller (rev 09)
on the motherboard, which is supported by your kernel, so I can't tell how the drive is connected there.

In your original pqst,
Code:
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 1.5 Gb/s)
the drive is only operating at SATA 1 speeds, so nothing is lost by using the on board SATA ports.
To make that happen, rebuild your kernel with CONFIG_SATA_NV on and do not connect the 4Tb to the Fusion-MPT card.

The kernel may reorder your sda and sdb when you do that.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
mauricev
Apprentice
Apprentice


Joined: 22 Mar 2004
Posts: 151

PostPosted: Sun Apr 16, 2017 4:17 am    Post subject: Reply with quote

Holy smokes, my not working computer has two onboard SATA interfaces, an NVIDIA and the LSI Logic. (How many computers ever made have that? 8O) The 4TB drive was connected to the LSI. When I connected the drive to the NVIDIA and recompiled with CONFIG_SATA_NV, the drive is seen thusly:

Code:
Disk /dev/sdb: 7814037168 sectors, 3.6 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 273A110E-A392-4277-ACD0-F05020E10446
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 7814037134
Partitions will be aligned on 2048-sector boundaries
Total free space is 2014 sectors (1007.0 KiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1            2048      7814037134   3.6 TiB     8300  Linux filesystem


So it works!

It sounds like there is a bug in the onboard LSI hardware itself (since they are using the identical driver), preventing it from dealing with advanced format disks properly.

Thank you for your help. I would have never in million years knew there was a second SATA interface on board to try.
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 43546
Location: 56N 3W

PostPosted: Sun Apr 16, 2017 8:43 am    Post subject: Reply with quote

mauricev,

Its probably a firmware issue on the Fusion-MPT board. As both interfaces are the same speed (SATA 1), it probably not worth trying a firmware update.
At a guess, the Fusion-MPT firmware is not aware of the LBA48 field in the Identify command response, so is unaware of drives larger that 2TiB.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Unsupported Software All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum