HDD problems causing Kernel panics in Linux/Debian?
in [Linux Hardware]
|
Prev: Upgraded my old Debian box to Kernel 2.6.32, but missing sensors datas and can't compile the latest stable NVIDIA driver.
Next: Logs and dumps for kernel panics to collect and analyze?
From: Ant on 6 Mar 2010 01:50 I was poking around to see why my old Linux/Debian box was rarely and randomly crashing with kernel panics. I read that its errors can be found in /var/log/syslog (dmesg didn't show me anything related to Kernel panics that I could find): # cat /var/log/syslog .... Mar 4 23:12:07 foobar smartd[2647]: Device: /dev/hda, SMART Usage Attribute: 194 Temperature_Celsius changed from 30 to 31 .... Mar 5 15:11:31 foobar smartd[2610]: Device: /dev/hda, SMART Prefailure Attribute: 1 Raw_Read_Error_Rate changed from 58 to 59 Mar 5 15:11:31 foobar smartd[2610]: Device: /dev/hda, SMART Usage Attribute: 195 Hardware_ECC_Recovered changed from 58 to 59 Mar 5 15:15:01 foobar /USR/SBIN/CRON[8815]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 15:17:01 foobar /USR/SBIN/CRON[11199]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Mar 5 15:25:01 foobar /USR/SBIN/CRON[20721]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 15:35:01 foobar /USR/SBIN/CRON[32588]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 15:45:01 foobar /USR/SBIN/CRON[12129]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 15:55:01 foobar /USR/SBIN/CRON[23947]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) < rebooted my crashed PC from its kernel panic > Mar 5 21:05:19 foobar syslogd 1.5.0#5: restart. .... I couldn't find any similiar from an earlier one like: .... Mar 5 05:17:01 foobar /USR/SBIN/CRON[26833]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Mar 5 05:25:01 foobar /USR/SBIN/CRON[29514]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 05:35:01 foobar /USR/SBIN/CRON[372]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 05:45:01 foobar /USR/SBIN/CRON[3772]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 05:55:01 foobar /USR/SBIN/CRON[7160]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 06:41:19 foobar syslogd 1.5.0#5: restart. .... # hdparm /dev/hda /dev/hda: multcount = 16 (on) IO_support = 1 (32-bit) unmaskirq = 1 (on) using_dma = 1 (on) keepsettings = 0 (off) readonly = 0 (off) readahead = 256 (on) geometry = 16383/255/63, sectors = 156301488, start = 0 foobar:/home/ant/download# hdparm /dev/hda^C foobar:/home/ant/download# smartctl -a /dev/hda smartctl 5.40 2010-02-03 r3060 [i686-pc-linux-gnu] (local build) Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net === START OF INFORMATION SECTION === Model Family: Seagate Barracuda 7200.7 and 7200.7 Plus family Device Model: ST380011A Serial Number: 4JV5P7LN Firmware Version: 8.01 User Capacity: 80,026,361,856 bytes Device is: In smartctl database [for details use: -P show] ATA Version is: 6 ATA Standard is: ATA/ATAPI-6 T13 1410D revision 2 Local Time is: Fri Mar 5 22:32:16 2010 PST SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x82) Offline data collection activity was completed without error. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 430) seconds. Offline data collection capabilities: (0x5b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. No Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 58) minutes. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 060 056 006 Pre-fail Always - 40077017 3 Spin_Up_Time 0x0003 098 098 000 Pre-fail Always - 0 4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 0 5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0 7 Seek_Error_Rate 0x000f 085 060 030 Pre-fail Always - 339834978 9 Power_On_Hours 0x0032 060 060 000 Old_age Always - 35554 10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 289 194 Temperature_Celsius 0x0022 030 048 000 Old_age Always - 30 195 Hardware_ECC_Recovered 0x001a 060 055 000 Old_age Always - 40077017 197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0 200 Multi_Zone_Error_Rate 0x0000 100 253 000 Old_age Offline - 0 202 Data_Address_Mark_Errs 0x0032 100 253 000 Old_age Always - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Extended offline Completed without error 00% 31886 - # 2 Extended offline Completed without error 00% 22233 - # 3 Extended offline Completed without error 00% 18951 - # 4 Extended offline Completed without error 00% 18674 - # 5 Extended offline Completed without error 00% 15957 - # 6 Extended offline Completed without error 00% 14448 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay. Are those bad? Thank you in advance. :) -- "If they are offered winged ants, people will eat them." --African /\___/\ / /\ /\ \ Phil./Ant @ http://antfarm.ma.cx (Personal Web Site) | |o o| | Ant's Quality Foraged Links: http://aqfl.net \ _ / Nuke ANT from e-mail address: philpi(a)earthlink.netANT ( ) or ANTant(a)zimage.com Ant is currently not listening to any songs on his home computer.
From: Arno on 6 Mar 2010 02:17 In comp.sys.ibm.pc.hardware.storage Ant <ant(a)zimage.comant> wrote: > I was poking around to see why my old Linux/Debian box was rarely and > randomly crashing with kernel panics. I read that its errors can be > found in /var/log/syslog (dmesg didn't show me anything related to > Kernel panics that I could find): The problem is that on a kernel panic, all disk access is aborted, hence no log entries. You find the explanations on the text console, which you also need to configure to not blank the screen (as unblanking is not possible after a kernel panic, at least it used to be impossible). Disk errors should not cuase a kernel panic, unless it is the root partition, that became unusable. Arno > # cat /var/log/syslog > ... > Mar 4 23:12:07 foobar smartd[2647]: Device: /dev/hda, SMART Usage > Attribute: 194 Temperature_Celsius changed from 30 to 31 > ... > Mar 5 15:11:31 foobar smartd[2610]: Device: /dev/hda, SMART Prefailure > Attribute: 1 Raw_Read_Error_Rate changed from 58 to 59 > Mar 5 15:11:31 foobar smartd[2610]: Device: /dev/hda, SMART Usage > Attribute: 195 Hardware_ECC_Recovered changed from 58 to 59 > Mar 5 15:15:01 foobar /USR/SBIN/CRON[8815]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > Mar 5 15:17:01 foobar /USR/SBIN/CRON[11199]: (root) CMD ( cd / && > run-parts --report /etc/cron.hourly) > Mar 5 15:25:01 foobar /USR/SBIN/CRON[20721]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > Mar 5 15:35:01 foobar /USR/SBIN/CRON[32588]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > Mar 5 15:45:01 foobar /USR/SBIN/CRON[12129]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > Mar 5 15:55:01 foobar /USR/SBIN/CRON[23947]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > < rebooted my crashed PC from its kernel panic > > Mar 5 21:05:19 foobar syslogd 1.5.0#5: restart. > ... > I couldn't find any similiar from an earlier one like: > ... > Mar 5 05:17:01 foobar /USR/SBIN/CRON[26833]: (root) CMD ( cd / && > run-parts --report /etc/cron.hourly) > Mar 5 05:25:01 foobar /USR/SBIN/CRON[29514]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > Mar 5 05:35:01 foobar /USR/SBIN/CRON[372]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > Mar 5 05:45:01 foobar /USR/SBIN/CRON[3772]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > Mar 5 05:55:01 foobar /USR/SBIN/CRON[7160]: (root) CMD (command -v > debian-sa1 > /dev/null && debian-sa1 1 1) > Mar 5 06:41:19 foobar syslogd 1.5.0#5: restart. > ... > # hdparm /dev/hda > /dev/hda: > multcount = 16 (on) > IO_support = 1 (32-bit) > unmaskirq = 1 (on) > using_dma = 1 (on) > keepsettings = 0 (off) > readonly = 0 (off) > readahead = 256 (on) > geometry = 16383/255/63, sectors = 156301488, start = 0 > foobar:/home/ant/download# hdparm /dev/hda^C > foobar:/home/ant/download# smartctl -a /dev/hda > smartctl 5.40 2010-02-03 r3060 [i686-pc-linux-gnu] (local build) > Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net > === START OF INFORMATION SECTION === > Model Family: Seagate Barracuda 7200.7 and 7200.7 Plus family > Device Model: ST380011A > Serial Number: 4JV5P7LN > Firmware Version: 8.01 > User Capacity: 80,026,361,856 bytes > Device is: In smartctl database [for details use: -P show] > ATA Version is: 6 > ATA Standard is: ATA/ATAPI-6 T13 1410D revision 2 > Local Time is: Fri Mar 5 22:32:16 2010 PST > SMART support is: Available - device has SMART capability. > SMART support is: Enabled > === START OF READ SMART DATA SECTION === > SMART overall-health self-assessment test result: PASSED > General SMART Values: > Offline data collection status: (0x82) Offline data collection activity > was completed without error. > Auto Offline Data Collection: > Enabled. > Self-test execution status: ( 0) The previous self-test routine > completed > without error or no self-test > has ever > been run. > Total time to complete Offline > data collection: ( 430) seconds. > Offline data collection > capabilities: (0x5b) SMART execute Offline immediate. > Auto Offline data collection > on/off support. > Suspend Offline collection upon new > command. > Offline surface scan supported. > Self-test supported. > No Conveyance Self-test supported. > Selective Self-test supported. > SMART capabilities: (0x0003) Saves SMART data before entering > power-saving mode. > Supports SMART auto save timer. > Error logging capability: (0x01) Error logging supported. > General Purpose Logging supported. > Short self-test routine > recommended polling time: ( 1) minutes. > Extended self-test routine > recommended polling time: ( 58) minutes. > SMART Attributes Data Structure revision number: 10 > Vendor Specific SMART Attributes with Thresholds: > ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE > UPDATED WHEN_FAILED RAW_VALUE > 1 Raw_Read_Error_Rate 0x000f 060 056 006 Pre-fail > Always - 40077017 > 3 Spin_Up_Time 0x0003 098 098 000 Pre-fail > Always - 0 > 4 Start_Stop_Count 0x0032 100 100 020 Old_age > Always - 0 > 5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail > Always - 0 > 7 Seek_Error_Rate 0x000f 085 060 030 Pre-fail > Always - 339834978 > 9 Power_On_Hours 0x0032 060 060 000 Old_age > Always - 35554 > 10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail > Always - 0 > 12 Power_Cycle_Count 0x0032 100 100 020 Old_age > Always - 289 > 194 Temperature_Celsius 0x0022 030 048 000 Old_age Always > - 30 > 195 Hardware_ECC_Recovered 0x001a 060 055 000 Old_age Always > - 40077017 > 197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always > - 0 > 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age > Offline - 0 > 199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always > - 0 > 200 Multi_Zone_Error_Rate 0x0000 100 253 000 Old_age > Offline - 0 > 202 Data_Address_Mark_Errs 0x0032 100 253 000 Old_age Always > - 0 > SMART Error Log Version: 1 > No Errors Logged > SMART Self-test log structure revision number 1 > Num Test_Description Status Remaining > LifeTime(hours) LBA_of_first_error > # 1 Extended offline Completed without error 00% 31886 > - > # 2 Extended offline Completed without error 00% 22233 > - > # 3 Extended offline Completed without error 00% 18951 > - > # 4 Extended offline Completed without error 00% 18674 > - > # 5 Extended offline Completed without error 00% 15957 > - > # 6 Extended offline Completed without error 00% 14448 > - > SMART Selective self-test log data structure revision number 1 > SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS > 1 0 0 Not_testing > 2 0 0 Not_testing > 3 0 0 Not_testing > 4 0 0 Not_testing > 5 0 0 Not_testing > Selective self-test flags (0x0): > After scanning selected spans, do NOT read-scan remainder of disk. > If Selective self-test is pending on power-up, resume after 0 minute delay. > Are those bad? Thank you in advance. :) > -- > "If they are offered winged ants, people will eat them." --African > /\___/\ > / /\ /\ \ Phil./Ant @ http://antfarm.ma.cx (Personal Web Site) > | |o o| | Ant's Quality Foraged Links: http://aqfl.net > \ _ / Nuke ANT from e-mail address: philpi(a)earthlink.netANT > ( ) or ANTant(a)zimage.com > Ant is currently not listening to any songs on his home computer. -- Arno Wagner, Dr. sc. techn., Dipl. Inform., CISSP -- Email: arno(a)wagner.name GnuPG: ID: 1E25338F FP: 0C30 5782 9D93 F785 E79C 0296 797F 6B50 1E25 338F ---- Cuddly UI's are the manifestation of wishful thinking. -- Dylan Evans
From: jan olieslagers on 6 Mar 2010 03:07 Arno schreef: > Disk errors should not cuase a kernel panic, unless it is > the root partition, that became unusable. Or swap ? On Solaris at least, loosing an active swap volume is deadly, or used to be.
From: Ant on 6 Mar 2010 03:12 On 3/5/2010 11:17 PM PT, Arno typed: > In comp.sys.ibm.pc.hardware.storage Ant<ant(a)zimage.comant> wrote: >> I was poking around to see why my old Linux/Debian box was rarely and >> randomly crashing with kernel panics. I read that its errors can be >> found in /var/log/syslog (dmesg didn't show me anything related to >> Kernel panics that I could find): > > The problem is that on a kernel panic, all disk access is > aborted, hence no log entries. You find the explanations > on the text console, which you also need to configure to > not blank the screen (as unblanking is not possible after > a kernel panic, at least it used to be impossible). > > Disk errors should not cuase a kernel panic, unless it is > the root partition, that became unusable. OK and thanks. FYI, I ran a full test on my /dev/hda and it said no errors: Mar 5 21:35:33 foobar smartd[2611]: Device: /dev/hda, SMART Prefailure Attribute: 1 Raw_Read_Error_Rate changed from 62 to 60 Mar 5 21:35:33 foobar smartd[2611]: Device: /dev/hda, SMART Usage Attribute: 194 Temperature_Celsius changed from 31 to 30 Mar 5 21:35:33 foobar smartd[2611]: Device: /dev/hda, SMART Usage Attribute: 195 Hardware_ECC_Recovered changed from 62 to 60 Mar 5 21:45:01 foobar /USR/SBIN/CRON[10906]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 21:55:01 foobar /USR/SBIN/CRON[11285]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 22:05:01 foobar /USR/SBIN/CRON[11662]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 22:15:01 foobar /USR/SBIN/CRON[12066]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 22:17:01 foobar /USR/SBIN/CRON[12154]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Mar 5 22:25:01 foobar /USR/SBIN/CRON[12481]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 22:35:01 foobar /USR/SBIN/CRON[12900]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 22:45:01 foobar /USR/SBIN/CRON[13307]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 22:55:02 foobar /USR/SBIN/CRON[13727]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 23:05:02 foobar /USR/SBIN/CRON[14116]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 23:05:33 foobar smartd[2611]: Device: /dev/hda, SMART Prefailure Attribute: 1 Raw_Read_Error_Rate changed from 60 to 61 Mar 5 23:05:33 foobar smartd[2611]: Device: /dev/hda, SMART Usage Attribute: 194 Temperature_Celsius changed from 30 to 35 Mar 5 23:05:33 foobar smartd[2611]: Device: /dev/hda, SMART Usage Attribute: 195 Hardware_ECC_Recovered changed from 60 to 61 Mar 5 23:05:33 foobar smartd[2611]: Device: /dev/hda, self-test in progress, 20% remaining Mar 5 23:15:01 foobar /USR/SBIN/CRON[14500]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 23:17:01 foobar /USR/SBIN/CRON[14599]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Mar 5 23:25:01 foobar /USR/SBIN/CRON[14905]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 23:35:01 foobar /USR/SBIN/CRON[15285]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 23:35:32 foobar smartd[2611]: Device: /dev/hda, SMART Prefailure Attribute: 1 Raw_Read_Error_Rate changed from 61 to 60 Mar 5 23:35:32 foobar smartd[2611]: Device: /dev/hda, SMART Usage Attribute: 194 Temperature_Celsius changed from 35 to 32 Mar 5 23:35:32 foobar smartd[2611]: Device: /dev/hda, SMART Usage Attribute: 195 Hardware_ECC_Recovered changed from 61 to 60 Mar 5 23:35:32 foobar smartd[2611]: Device: /dev/hda, previous self-test completed without error Mar 5 23:45:01 foobar /USR/SBIN/CRON[15679]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 23:55:01 foobar /USR/SBIN/CRON[16073]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 5 23:59:01 foobar /USR/SBIN/CRON[16272]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 60 2) Mar 6 00:05:01 foobar /USR/SBIN/CRON[16506]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 6 00:05:32 foobar smartd[2611]: Device: /dev/hda, SMART Usage Attribute: 194 Temperature_Celsius changed from 32 to 31 -- "Ladies and gentlemen, er, we've just lost the picture, but, uh, what we've seen speaks for itself. The Corvair spacecraft has been taken over--'conquered', if you will--by a master race of giant space ants. It's difficult to tell from this vantage point whether they will consume the captive earth men or merely enslave them. One thing is for certain, there is no stopping them; the ants will soon be here. And I, for one, welcome our new insect overlords. I'd like to remind them that as a trusted TV personality, I can be helpful in rounding up others to...toil in their underground sugar caves."--Kent Brockman in The Simpsons' Deep Space Homer (1F13) episode. /\___/\ / /\ /\ \ Phil./Ant @ http://antfarm.ma.cx (Personal Web Site) | |o o| | Ant's Quality Foraged Links: http://aqfl.net \ _ / Nuke ANT from e-mail address: philpi(a)earthlink.netANT ( ) or ANTant(a)zimage.com Ant is currently not listening to any songs on his home computer.
From: Pascal Hambourg on 6 Mar 2010 05:22
Hello, Ant a �crit : > I was poking around to see why my old Linux/Debian box was rarely and > randomly crashing with kernel panics. I read that its errors can be > found in /var/log/syslog (dmesg didn't show me anything related to > Kernel panics that I could find): > > # cat /var/log/syslog > ... > Mar 4 23:12:07 foobar smartd[2647]: Device: /dev/hda, SMART Usage > Attribute: 194 Temperature_Celsius changed from 30 to 31 > ... > Mar 5 15:11:31 foobar smartd[2610]: Device: /dev/hda, SMART Prefailure > Attribute: 1 Raw_Read_Error_Rate changed from 58 to 59 > Mar 5 15:11:31 foobar smartd[2610]: Device: /dev/hda, SMART Usage > Attribute: 195 Hardware_ECC_Recovered changed from 58 to 59 These are not errors but just (useless IMHO) notifications on SMART attribute changes. > foobar:/home/ant/download# smartctl -a /dev/hda [...] From this, hda seems to be perfectly healthy. |