I was able to connect an EC2 instance through SSH
However, it keeps fail and timed out after i followed to step 3 of below article
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/SSL-on-an-instance.html
Literally, I have just installed ssl_mod and reboot the instance, afterwards the instance cannot be accessed again by putty.
And There is no way to access the EC2 instance anymore.
Any way to solve this issue?
-----System log------
[ 0.000000] Linux version 4.14.101-75.76.amzn1.x86_64 (mockbuild#gobi-build-60003) (gcc version 7.2.1 20170915 (Red Hat 7.2.1-2) (GCC)) #1 SMP Tue Feb 19 18:14:51 UTC 2019
[ 0.000000] Command line: root=LABEL=/ console=tty1 console=ttyS0 selinux=0 nvme_core.io_timeout=4294967295 LANG=en_US.UTF-8 KEYTABLE=us
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fffffff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.7 present.
[ 0.000000] DMI: Xen HVM domU, BIOS 4.2.amazon 08/24/2006
[ 0.000000] Hypervisor detected: Xen HVM
[ 0.000000] Xen version 4.2.
[ 0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[ 0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
[ 0.000000] You might have to change the root device
[ 0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
[ 0.000000] in your root= kernel command line option
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.000000] e820: last_pfn = 0x40000 max_arch_pfn = 0x400000000
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.000000] found SMP MP-table at [mem 0x000fbc50-0x000fbc5f] mapped at [ffffffffff240c50]
[ 0.000000] RAMDISK: [mem 0x37087000-0x37feffff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen )
[ 0.000000] ACPI: XSDT 0x00000000FC00E2A0 000054 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: FACP 0x00000000FC00DF60 0000F4 (v04 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: DSDT 0x00000000FC0021C0 00BD19 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] ACPI: FACS 0x00000000FC002180 000040
[ 0.000000] ACPI: FACS 0x00000000FC002180 000040
[ 0.000000] ACPI: APIC 0x00000000FC00E060 0000D8 (v02 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: HPET 0x00000000FC00E1B0 000038 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: WAET 0x00000000FC00E1F0 000028 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: SSDT 0x00000000FC00E220 000031 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] ACPI: SSDT 0x00000000FC00E260 000031 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000003fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x3ffde000-0x3fffffff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x000000003fffffff]
[ 0.000000] Normal empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009dfff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x000000003fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000003fffffff]
[ 0.000000] ACPI: PM-Timer IO Port: 0xb008
[ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] smpboot: Allowing 15 CPUs, 14 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] e820: [mem 0x40000000-0xfbffffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on Xen HVM
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:15 nr_cpu_ids:15 nr_node_ids:1
[ 0.000000] percpu: Embedded 44 pages/cpu #ffff88803e200000 s140120 r8192 d31912 u262144
[ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 257928
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: root=LABEL=/ console=tty1 console=ttyS0 selinux=0 nvme_core.io_timeout=4294967295 LANG=en_US.UTF-8 KEYTABLE=us
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Memory: 988260K/1048180K available (8204K kernel code, 1920K rwdata, 2768K rodata, 2044K init, 3876K bss, 59920K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[ 0.000000] Kernel/User page tables isolation: enabled
[ 0.000000] ftrace: allocating 25766 entries in 101 pages
[ 0.004000] Hierarchical RCU implementation.
[ 0.004000] RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=15.
[ 0.004000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=15
[ 0.004000] NR_IRQS: 524544, nr_irqs: 952, preallocated irqs: 16
[ 0.004000] xen:events: Using 2-level ABI
[ 0.004000] xen:events: Xen HVM callback vector for event delivery is enabled
[ 0.004000] Console: colour VGA+ 80x25
[ 0.004000] console [tty1] enabled
[ 0.004000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[ 0.004000] console [ttyS0] enabled
[ 0.004000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns
[ 0.008000] tsc: Fast TSC calibration using PIT
[ 0.020004] tsc: Detected 2399.921 MHz processor
[ 0.024009] Calibrating delay loop (skipped), value calculated using timer frequency.. 4800.12 BogoMIPS (lpj=9600256)
[ 0.032003] pid_max: default: 32768 minimum: 301
[ 0.036018] ACPI: Core revision 20170728
[ 0.046999] ACPI: 3 ACPI AML tables successfully acquired and loaded
[ 0.052025] Security Framework initialized
[ 0.056038] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.060085] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.064019] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes)
[ 0.072006] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes)
[ 0.076233] mce: CPU supports 2 MCE banks
[ 0.080026] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[ 0.084002] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[ 0.092004] Spectre V2 : Mitigation: Full generic retpoline
[ 0.096002] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[ 0.100005] Speculative Store Bypass: Vulnerable
[ 0.113770] smpboot: Max logical packages: 15
[ 0.116757] x2apic: IRQ remapping doesn't support X2APIC mode
[ 0.120003] Switched APIC routing to physical flat.
[ 0.126535] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[ 0.174541] clocksource: xen: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[ 0.180019] installing Xen timer for CPU 0
[ 0.188076] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2676 v3 # 2.40GHz (family: 0x6, model: 0x3f, stepping: 0x2)
[ 0.192033] cpu 0 spinlock event irq 53
[ 0.195817] Performance Events: unsupported p6 CPU model 63 no PMU driver, software events only.
[ 0.196036] Hierarchical SRCU implementation.
[ 0.200295] NMI watchdog: Perf event create on CPU 0 failed with -2
[ 0.204006] NMI watchdog: Perf NMI watchdog permanently disabled
[ 0.208185] smp: Bringing up secondary CPUs ...
[ 0.211932] smp: Brought up 1 node, 1 CPU
[ 0.212008] smpboot: Total of 1 processors activated (4800.12 BogoMIPS)
[ 0.216442] devtmpfs: initialized
[ 0.219675] x86/mm: Memory block size: 128MB
[ 0.220224] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 0.224020] futex hash table entries: 4096 (order: 6, 262144 bytes)
[ 0.228273] NET: Registered protocol family 16
[ 0.232242] cpuidle: using governor ladder
[ 0.236007] cpuidle: using governor menu
[ 0.239387] ACPI: bus type PCI registered
[ 0.240005] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 0.244347] PCI: Using configuration type 1 for base access
[ 0.250764] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[ 0.252194] ACPI: Added _OSI(Module Device)
[ 0.256011] ACPI: Added _OSI(Processor Device)
[ 0.260005] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.264007] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.271170] ACPI: Interpreter enabled
[ 0.272019] ACPI: (supports S0 S4 S5)
[ 0.275388] ACPI: Using IOAPIC for interrupt routing
[ 0.276049] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.280422] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 0.334308] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.336012] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[ 0.340012] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[ 0.344020] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 0.349096] acpiphp: Slot [0] registered
[ 0.353056] acpiphp: Slot [3] registered
[ 0.356406] acpiphp: Slot [4] registered
[ 0.359996] acpiphp: Slot [5] registered
[ 0.360414] acpiphp: Slot [6] registered
[ 0.363957] acpiphp: Slot [7] registered
[ 0.364418] acpiphp: Slot [8] registered
[ 0.368008] acpiphp: Slot [9] registered
[ 0.371580] acpiphp: Slot [10] registered
[ 0.372415] acpiphp: Slot [11] registered
[ 0.375900] acpiphp: Slot [12] registered
[ 0.376411] acpiphp: Slot [13] registered
[ 0.380000] acpiphp: Slot [14] registered
[ 0.380427] acpiphp: Slot [15] registered
[ 0.384079] acpiphp: Slot [16] registered
[ 0.387800] acpiphp: Slot [17] registered
[ 0.388411] acpiphp: Slot [18] registered
[ 0.392000] acpiphp: Slot [19] registered
[ 0.392412] acpiphp: Slot [20] registered
[ 0.395992] acpiphp: Slot [21] registered
[ 0.396419] acpiphp: Slot [22] registered
[ 0.400000] acpiphp: Slot [23] registered
[ 0.400406] acpiphp: Slot [24] registered
[ 0.403896] acpiphp: Slot [25] registered
[ 0.404408] acpiphp: Slot [26] registered
[ 0.408261] acpiphp: Slot [27] registered
[ 0.411817] acpiphp: Slot [28] registered
[ 0.412417] acpiphp: Slot [29] registered
[ 0.416044] acpiphp: Slot [30] registered
[ 0.419707] acpiphp: Slot [31] registered
[ 0.420356] PCI host bridge to bus 0000:00
[ 0.423606] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 0.424009] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 0.428008] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 0.432006] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff window]
[ 0.436005] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.447197] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 0.448006] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 0.452004] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 0.456004] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 0.460733] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
[ 0.460733] * this clock source is slow. Consider trying other clock sources
[ 0.465592] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI
[ 0.476152] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
[ 0.480222] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[ 0.484220] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[ 0.488237] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
[ 0.511891] xen:balloon: Initialising balloon driver
[ 0.520142] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[ 0.524000] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 0.524010] pci 0000:00:02.0: vgaarb: bridge control possible
[ 0.528004] vgaarb: loaded
[ 0.531106] EDAC MC: Ver: 3.0.0
[ 0.532587] PCI: Using ACPI for IRQ routing
[ 0.536465] NetLabel: Initializing
[ 0.539477] NetLabel: domain hash size = 128
[ 0.540005] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 0.544024] NetLabel: unlabeled traffic allowed by default
[ 0.548042] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[ 0.552017] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 0.555868] hpet0: 3 comparators, 64-bit 62.500000 MHz counter
[ 0.558213] clocksource: Switched to clocksource xen
[ 0.568083] VFS: Disk quotas dquot_6.6.0
[ 0.573690] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.581819] pnp: PnP ACPI init
[ 0.586116] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
[ 0.594537] system 00:01: [io 0x08a0-0x08a3] has been reserved
[ 0.601500] system 00:01: [io 0x0cc0-0x0ccf] has been reserved
[ 0.608222] system 00:01: [io 0x04d0-0x04d1] has been reserved
[ 0.612991] system 00:07: [io 0x10c0-0x1141] has been reserved
[ 0.617641] system 00:07: [io 0xb044-0xb047] has been reserved
[ 0.641810] pnp: PnP ACPI: found 8 devices
[ 0.651918] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 0.659212] NET: Registered protocol family 2
[ 0.662987] TCP established hash table entries: 8192 (order: 4, 65536 bytes)
[ 0.668084] TCP bind hash table entries: 8192 (order: 5, 131072 bytes)
[ 0.672829] TCP: Hash tables configured (established 8192 bind 8192)
[ 0.677593] UDP hash table entries: 512 (order: 2, 16384 bytes)
[ 0.684367] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
[ 0.689599] NET: Registered protocol family 1
[ 0.693893] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 0.698659] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[ 0.703208] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 0.713135] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 0.723220] Unpacking initramfs...
[ 0.864063] random: fast init done
[ 0.968913] Freeing initrd memory: 15780K
[ 0.974092] audit: initializing netlink subsys (disabled)
[ 0.981075] Initialise system trusted keyrings
[ 0.984736] random: get_random_bytes called from key_alloc+0x209/0x430 with crng_init=1
[ 0.990943] Key type blacklist registered
[ 0.994506] audit: type=2000 audit(1551756108.573:1): state=initialized audit_enabled=0 res=1
[ 1.000910] workingset: timestamp_bits=36 max_order=18 bucket_order=0
[ 1.006273] zbud: loaded
[ 1.284352] Key type asymmetric registered
[ 1.287742] Asymmetric key parser 'x509' registered
[ 1.291498] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[ 1.297323] io scheduler noop registered (default)
[ 1.301463] xen:grant_table: Grant tables using version 1 layout
[ 1.305870] Grant table initialized
[ 1.309041] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[ 1.313703] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[ 1.346384] 00:06: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 1.352887] xen_netfront: Initialising Xen virtual ethernet driver
[ 1.358641] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
[ 1.366855] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 1.370698] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 1.375506] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[ 1.382858] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[ 1.387621] rtc_cmos 00:02: alarms up to one day, 114 bytes nvram, hpet irqs
[ 1.392869] hidraw: raw HID events driver (C) Jiri Kosina
[ 1.397109] NET: Registered protocol family 17
[ 1.400947] sched_clock: Marking stable (1400624129, 0)->(2253558423, -852934294)
[ 1.407324] registered taskstats version 1
[ 1.411259] Loading compiled-in X.509 certificates
[ 1.415069] zswap: loaded using pool lzo/zbud
[ 1.520120] xenbus_probe_frontend: Device with no driver: device/vbd/51712
[ 1.525300] rtc_cmos 00:02: setting system clock to 2019-03-05 03:21:49 UTC (1551756109)
[ 1.533509] Freeing unused kernel memory: 2044K
[ 1.544082] Write protecting the kernel read-only data: 14336k
[ 1.548953] Freeing unused kernel memory: 2016K
[ 1.554984] Freeing unused kernel memory: 1328K
[ 1.575051] device-mapper: uevent: version 1.0.3
[ 1.579046] device-mapper: ioctl: 4.37.0-ioctl (2017-09-20) initialised: dm-devel#redhat.com
[ 1.589941] udevd[853]: starting version 173
[ 1.655508] SCSI subsystem initialized
[ 1.690059] Invalid max_queues (4), will use default max: 1.
[ 1.720512] scsi host0: ata_piix
[ 1.738747] blkfront: xvda: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: enabled;
[ 1.747115] scsi host1: ata_piix
[ 1.750384] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14
[ 1.755294] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15
[ 1.785880] xvda: xvda1
growroot: NOCHANGE: disk=/dev/xvda partition=1: size=16773086, it cannot be grown
[ 1.992025] tsc: Refined TSC clocksource calibration: 2400.000 MHz
[ 1.996677] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns
[ 2.007196] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null)
[ 2.017844] dracut: Mounted root filesystem /dev/xvda1
[ 2.054536] dracut: Switching root
[ 2.102376] random: init: uninitialized urandom read (12 bytes read)
Couple of questions:
1. What OS are you using? I'm assuming Amazon Linux but want to confirm...
2. Did you do anything to change security groups in the Management Console? What are your security group / VPC config?
3. Are you shutting down the instance then turning it back on or did you reboot? How did you do this (either command or management console action)?
4. In the management console can you get the system log and paste here?
It is likely:
1. You configured a firewall or your security groups are not right.
2. You shut down an instance with an auto-assigned public IP. In this case the IP will change.
3. You did something that nuked a system service which is preventing the machine from booting.
The application is basically a Servlet on top of Apaches Tomcat 8 and crashes every 3 to n days. The most interesting part is, that the last 3 crashes happened at 1.30 PM + 3 to 4 seconds. Every other crash happens at 15, 30, 45 or the full hour. The same application worked for months on Windows 7 with Java 7 something.
I found this report so I checked the available space at /tmp and I have plenty of space here. However, the next time I ran the VM with:
-XX:-UsePerfData
-XX:+PerfDisableSharedMem
and the hsperfdata file is no longer written but the problem persist. According to this report PerfData might be still used to some extend even if it is disabled.
It seems to be this piece of code:
void PerfLongVariant::sample() {
// JJJ - This should not happen. Maybe the first sample is taken
// while the _sample_helper is being null'ed out.
// assert(_sample_helper != NULL || _sampled != NULL, "unexpected state");
if (_sample_helper == NULL) return;
if (_sample_helper != NULL) {
*(jlong*)_valuep = _sample_helper->take_sample();
}
else if (_sampled != NULL) {
*(jlong*)_valuep = *_sampled;
}
}
I assume the problem occures here:
*(jlong*)_valuep = _sample_helper->take_sample();
but I am not sure which implementation is used at runtime:
statSampler seems unlikely as I don't see the connection to elapsed_counter except for the above mentioned phenomena with the crash time.
/*
* helper class to provide for sampling of the elapsed_counter value
* maintained in the OS class.
*/
class HighResTimeSampler : public PerfSampleHelper {
public:
jlong take_sample() { return os::elapsed_counter(); }
};
or gSpaceCounter
inline jlong take_sample() {
return _gen->used();
}
and spaceCounters and cSpaceCounter I have the impression that the size of one of the pools in the Java memory pool is returned before it is updated. Which ultimately lead to SIGBUS 7, bad memory access.
What are my options?
The last crash report (dynamic libraries removed):
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGBUS (0x7) at pc=0x00007f463c87a82e, pid=10876, tid=0x00007f4624cfc700
#
# JRE version: OpenJDK Runtime Environment (8.0_101-b13) (build 1.8.0_101-b13)
# Java VM: OpenJDK 64-Bit Server VM (25.101-b13 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea 3.1.0
# Distribution: Custom build (Fri Jul 29 23:44:32 UTC 2016)
# Problematic frame:
# V [libjvm.so+0x7f582e] PerfLongVariant::sample()+0x1e
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please include
# instructions on how to reproduce the bug and visit:
# http://icedtea.classpath.org/bugzilla
#
--------------- T H R E A D ---------------
Current thread (0x00007f46340ce800): WatcherThread [stack: 0x00007f4624bfc000,0x00007f4624cfd000] [id=10909]
siginfo: si_signo: 7 (SIGBUS), si_code: 2 (BUS_ADRERR), si_addr: 0x00007f463dc89420
Registers:
RAX=0x0000000007114e40, RBX=0x00007f463dc89420, RCX=0x0000000000000000, RDX=0x00007f463ce2d210
RSP=0x00007f4624cfbe00, RBP=0x00007f4624cfbe10, RSI=0x0000000000000032, RDI=0x00007f4634018fa0
R8 =0x00007f463ce69a48, R9 =0x0000000000000001, R10=0x00182e09a9af66e8, R11=0x0000000000000000
R12=0x0000000000000008, R13=0x00007f463401b1a0, R14=0x0000000000000002, R15=0x00007f463ce6f3c0
RIP=0x00007f463c87a82e, EFLAGS=0x0000000000010202, CSGSFS=0x0000000000000033, ERR=0x0000000000000007
TRAPNO=0x000000000000000e
Top of Stack: (sp=0x00007f4624cfbe00)
0x00007f4624cfbe00: 00007f46340ce800 0000000000000001
0x00007f4624cfbe10: 00007f4624cfbe40 00007f463c8ecd44
0x00007f4624cfbe20: 00007f4624cfbe40 0000000000000001
0x00007f4624cfbe30: 0000000000000032 0000000000000032
0x00007f4624cfbe40: 00007f4624cfbe90 00007f463c92e380
0x00007f4624cfbe50: 00007f46340cfad0 00007f4634007630
0x00007f4624cfbe60: 0000000000000000 0000000000000032
0x00007f4624cfbe70: 00007f46340ce800 00007f46340ce800
0x00007f4624cfbe80: 0000000000000000 00007f4624cfc700
0x00007f4624cfbe90: 00007f4624cfbf10 00007f463c954bf7
0x00007f4624cfbea0: 0000000000000000 0000000000000000
0x00007f4624cfbeb0: 0000000000000001 00007f46340ce800
0x00007f4624cfbec0: 00007f4624cfbf10 00007f463c80b8cf
0x00007f4624cfbed0: 0000000000000000 00007f46340cfbc0
0x00007f4624cfbee0: 00007f46340cfad0 00007f46340cfbc0
0x00007f4624cfbef0: 00007f46340cfad0 00007f46340ce800
0x00007f4624cfbf00: 0000000000000000 00007f4624cfc700
0x00007f4624cfbf10: 00007f4624cfbf50 00007f463c83e6d2
0x00007f4624cfbf20: 0000000000000000 0000000000000000
0x00007f4624cfbf30: 0000000000000000 00007f463dc70b5f
0x00007f4624cfbf40: 0000000000000000 00007f4624cfc700
0x00007f4624cfbf50: 0000000000000000 00007f463ce92734
0x00007f4624cfbf60: 0000000000000000 00007f4624cfc700
0x00007f4624cfbf70: 00007f4624cfc700 c5fe0a2abaafece4
0x00007f4624cfbf80: 0000000000000000 00007f463dc70b5f
0x00007f4624cfbf90: 0000000000000000 00007f4624cfc700
0x00007f4624cfbfa0: 3b7243b5c46fece4 3b7273f8f755ece4
0x00007f4624cfbfb0: 0000000000000000 0000000000000000
0x00007f4624cfbfc0: 0000000000000000 0000000000000000
0x00007f4624cfbfd0: 0000000000000000 0000000000000000
0x00007f4624cfbfe0: 0000000000000000 0000000000000000
0x00007f4624cfbff0: 00007f4624cfc700 00007f463d5aad3d
Instructions: (pc=0x00007f463c87a82e)
0x00007f463c87a80e: a0 ff 48 8b 47 38 48 85 c0 74 1e 55 48 89 e5 53
0x00007f463c87a81e: 48 83 ec 08 48 8b 5f 28 48 8b 10 48 89 c7 ff 12
0x00007f463c87a82e: 48 89 03 48 83 c4 08 5b 5d f3 c3 90 66 0f 1f 44
0x00007f463c87a83e: 00 00 55 48 8d 05 08 02 5b 00 48 89 e5 41 57 41
Stack: [0x00007f4624bfc000,0x00007f4624cfd000], sp=0x00007f4624cfbe00, free space=1023k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x7f582e] PerfLongVariant::sample()+0x1e
V [libjvm.so+0x867d44] StatSampler::sample_data(PerfDataList*)+0x34
V [libjvm.so+0x8a9380] PeriodicTask::real_time_tick(int)+0x90
V [libjvm.so+0x8cfbf7] WatcherThread::run()+0x47
V [libjvm.so+0x7b96d2] java_start(Thread*)+0xe2
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x00007f45f0011000 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon [_thread_blocked, id=15853, stack(0x00007f45e72f9000,0x00007f45e73fa000)]
0x00007f45f0010000 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon [_thread_blocked, id=15852, stack(0x00007f45f48ce000,0x00007f45f49cf000)]
0x00007f45f0018800 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon [_thread_blocked, id=15851, stack(0x00007f45e75fa000,0x00007f45e76fb000)]
0x00007f4600699000 JavaThread "BackendCache" daemon [_thread_blocked, id=15363, stack(0x00007f45e76fb000,0x00007f45e77fc000)]
0x00007f46352da800 JavaThread "Thread-9" daemon [_thread_blocked, id=15362, stack(0x00007f45e77fc000,0x00007f45e78fd000)]
0x00007f45ea07c800 JavaThread "Timer-0" daemon [_thread_blocked, id=15356, stack(0x00007f45f4063000,0x00007f45f4164000)]
0x00007f4634dd2000 JavaThread "Thread-4" daemon [_thread_blocked, id=15355, stack(0x00007f45f4564000,0x00007f45f4665000)]
0x00007f45ec04b000 JavaThread "http-apr-8080-exec-10" daemon [_thread_blocked, id=11253, stack(0x00007f45f49cf000,0x00007f45f4ad0000)]
0x00007f45f000b000 JavaThread "http-apr-8080-exec-9" daemon [_thread_blocked, id=11252, stack(0x00007f45f4ad0000,0x00007f45f4bd1000)]
0x00007f45f0009800 JavaThread "http-apr-8080-exec-8" daemon [_thread_blocked, id=11251, stack(0x00007f45f4bd1000,0x00007f45f4cd2000)]
0x00007f45f0007800 JavaThread "http-apr-8080-exec-7" daemon [_thread_blocked, id=11250, stack(0x00007f45f4cd2000,0x00007f45f4dd3000)]
0x00007f45f0006000 JavaThread "http-apr-8080-exec-6" daemon [_thread_blocked, id=11249, stack(0x00007f45f4dd3000,0x00007f45f4ed4000)]
0x00007f45ec03f800 JavaThread "http-apr-8080-exec-5" daemon [_thread_blocked, id=11248, stack(0x00007f45f4ed4000,0x00007f45f4fd5000)]
0x00007f45f0004000 JavaThread "http-apr-8080-exec-4" daemon [_thread_blocked, id=11247, stack(0x00007f45f4fd5000,0x00007f45f50d6000)]
0x00007f45f0002800 JavaThread "http-apr-8080-exec-3" daemon [_thread_blocked, id=10969, stack(0x00007f45f50d6000,0x00007f45f51d7000)]
0x00007f45ec079000 JavaThread "http-apr-8080-exec-2" daemon [_thread_blocked, id=10968, stack(0x00007f45f60c4000,0x00007f45f61c5000)]
0x00007f45f0001800 JavaThread "http-apr-8080-exec-1" daemon [_thread_blocked, id=10967, stack(0x00007f45f5fc3000,0x00007f45f60c4000)]
0x00007f463459b800 JavaThread "ajp-apr-8009-AsyncTimeout" daemon [_thread_blocked, id=10930, stack(0x00007f45f53d7000,0x00007f45f54d8000)]
0x00007f4634599800 JavaThread "ajp-apr-8009-Acceptor-0" daemon [_thread_in_native, id=10929, stack(0x00007f45f54d8000,0x00007f45f55d9000)]
0x00007f4634597800 JavaThread "ajp-apr-8009-Poller" daemon [_thread_blocked, id=10928, stack(0x00007f45f55d9000,0x00007f45f56da000)]
0x00007f4634595800 JavaThread "http-apr-8080-AsyncTimeout" daemon [_thread_blocked, id=10927, stack(0x00007f45f56da000,0x00007f45f57db000)]
0x00007f4634594800 JavaThread "http-apr-8080-Acceptor-0" daemon [_thread_in_native, id=10926, stack(0x00007f45f59db000,0x00007f45f5adc000)]
0x00007f4634592800 JavaThread "http-apr-8080-Sendfile" daemon [_thread_blocked, id=10925, stack(0x00007f45f5adc000,0x00007f45f5bdd000)]
0x00007f4634591000 JavaThread "http-apr-8080-Poller" daemon [_thread_blocked, id=10924, stack(0x00007f45f5c94000,0x00007f45f5d95000)]
0x00007f463458d800 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=10923, stack(0x00007f45f5ec2000,0x00007f45f5fc3000)]
0x00007f4634515800 JavaThread "GC Daemon" daemon [_thread_blocked, id=10911, stack(0x00007f45f7434000,0x00007f45f7535000)]
0x00007f4634145800 JavaThread "AsyncFileHandlerWriter-1878246837" daemon [_thread_blocked, id=10910, stack(0x00007f4624afb000,0x00007f4624bfc000)]
0x00007f46340cc000 JavaThread "Service Thread" daemon [_thread_blocked, id=10908, stack(0x00007f4624cfd000,0x00007f4624dfe000)]
0x00007f46340c7800 JavaThread "C1 CompilerThread1" daemon [_thread_blocked, id=10907, stack(0x00007f4624dfe000,0x00007f4624eff000)]
0x00007f46340ba000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=10906, stack(0x00007f4624eff000,0x00007f4625000000)]
0x00007f46340b8000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=10905, stack(0x00007f4638052000,0x00007f4638153000)]
0x00007f463408d800 JavaThread "Finalizer" daemon [_thread_blocked, id=10904, stack(0x00007f4638197000,0x00007f4638298000)]
0x00007f4634089000 JavaThread "Reference Handler" daemon [_thread_blocked, id=10903, stack(0x00007f4638298000,0x00007f4638399000)]
0x00007f4634008000 JavaThread "main" [_thread_in_native, id=10899, stack(0x00007f463db71000,0x00007f463dc72000)]
Other Threads:
0x00007f463407f800 VMThread [stack: 0x00007f4638399000,0x00007f463849a000] [id=10902]
=>0x00007f46340ce800 WatcherThread [stack: 0x00007f4624bfc000,0x00007f4624cfd000] [id=10909]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00007f4634007630] PeriodicTask_lock - owner thread: 0x00007f46340ce800
Heap:
PSYoungGen total 161792K, used 115891K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 71% used [0x00000000f6180000,0x00000000fd294e40,0x00000000fff00000)
from space 512K, 18% used [0x00000000fff00000,0x00000000fff18020,0x00000000fff80000)
to space 512K, 0% used [0x00000000fff80000,0x00000000fff80000,0x0000000100000000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31407K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
Card table byte_map: [0x00007f463aaea000,0x00007f463abd9000] byte_map_base: 0x00007f463a3d8000
Marking Bits: (ParMarkBitMap*) 0x00007f463ce6d740
Begin Bits: [0x00007f4639a08000, 0x00007f463a178000)
End Bits: [0x00007f463a178000, 0x00007f463a8e8000)
Polling page: 0x00007f463dc91000
CodeCache: size=245760Kb used=13583Kb max_used=14910Kb free=232176Kb
bounds [0x00007f4625000000, 0x00007f4625ec0000, 0x00007f4634000000]
total_blobs=4397 nmethods=3905 adapters=407
compilation: enabled
GC Heap History (10 events):
Event: 241117.477 GC heap before
{Heap before GC invocations=451 (full 2):
PSYoungGen total 161792K, used 161456K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 100% used [0x00000000f6180000,0x00000000fff00000,0x00000000fff00000)
from space 512K, 34% used [0x00000000fff80000,0x00000000fffac030,0x0000000100000000)
to space 512K, 0% used [0x00000000fff00000,0x00000000fff00000,0x00000000fff80000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31406K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
Event: 241117.480 GC heap after
Heap after GC invocations=451 (full 2):
PSYoungGen total 161792K, used 128K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 0% used [0x00000000f6180000,0x00000000f6180000,0x00000000fff00000)
from space 512K, 25% used [0x00000000fff00000,0x00000000fff20020,0x00000000fff80000)
to space 512K, 0% used [0x00000000fff80000,0x00000000fff80000,0x0000000100000000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31406K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
}
Event: 241985.401 GC heap before
{Heap before GC invocations=453 (full 2):
PSYoungGen total 161792K, used 161408K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 100% used [0x00000000f6180000,0x00000000fff00000,0x00000000fff00000)
from space 512K, 25% used [0x00000000fff80000,0x00000000fffa0020,0x0000000100000000)
to space 512K, 0% used [0x00000000fff00000,0x00000000fff00000,0x00000000fff80000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31407K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
Event: 241985.404 GC heap after
Heap after GC invocations=453 (full 2):
PSYoungGen total 161792K, used 96K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 0% used [0x00000000f6180000,0x00000000f6180000,0x00000000fff00000)
from space 512K, 18% used [0x00000000fff00000,0x00000000fff18020,0x00000000fff80000)
to space 512K, 0% used [0x00000000fff80000,0x00000000fff80000,0x0000000100000000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31407K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
}
Event: 242421.299 GC heap before
{Heap before GC invocations=454 (full 2):
PSYoungGen total 161792K, used 161376K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 100% used [0x00000000f6180000,0x00000000fff00000,0x00000000fff00000)
from space 512K, 18% used [0x00000000fff00000,0x00000000fff18020,0x00000000fff80000)
to space 512K, 0% used [0x00000000fff80000,0x00000000fff80000,0x0000000100000000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31407K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
Event: 242421.301 GC heap after
Heap after GC invocations=454 (full 2):
PSYoungGen total 161792K, used 112K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 0% used [0x00000000f6180000,0x00000000f6180000,0x00000000fff00000)
from space 512K, 21% used [0x00000000fff80000,0x00000000fff9c010,0x0000000100000000)
to space 512K, 0% used [0x00000000fff00000,0x00000000fff00000,0x00000000fff80000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31407K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
}
Event: 242856.234 GC heap before
{Heap before GC invocations=455 (full 2):
PSYoungGen total 161792K, used 161392K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 100% used [0x00000000f6180000,0x00000000fff00000,0x00000000fff00000)
from space 512K, 21% used [0x00000000fff80000,0x00000000fff9c010,0x0000000100000000)
to space 512K, 0% used [0x00000000fff00000,0x00000000fff00000,0x00000000fff80000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31407K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
Event: 242856.236 GC heap after
Heap after GC invocations=455 (full 2):
PSYoungGen total 161792K, used 96K [0x00000000f6180000, 0x0000000100000000, 0x0000000100000000)
eden space 161280K, 0% used [0x00000000f6180000,0x00000000f6180000,0x00000000fff00000)
from space 512K, 18% used [0x00000000fff00000,0x00000000fff18020,0x00000000fff80000)
to space 512K, 0% used [0x00000000fff80000,0x00000000fff80000,0x0000000100000000)
ParOldGen total 36352K, used 23540K [0x00000000e2400000, 0x00000000e4780000, 0x00000000f6180000)
object space 36352K, 64% used [0x00000000e2400000,0x00000000e3afd378,0x00000000e4780000)
Metaspace used 31407K, capacity 31972K, committed 32256K, reserved 1077248K
class space used 3342K, capacity 3473K, committed 3584K, reserved 1048576K
}
Internal exceptions (10 events):
Event: 57534.673 Thread 0x00007f4634dd2000 Exception <a 'java/lang/ClassNotFoundException': org/hibernate/util/CloneableCustomizer> (0x00000000faf05e08) thrown at [/home/abuild/rpmbuild/BUILD/icedtea-3.1.0/openjdk/hotspot/src/share/vm/classfile/systemDictionary.cpp, line 210]
Event: 57534.674 Thread 0x00007f4634dd2000 Exception <a 'java/lang/ClassNotFoundException': org/hibernate/event/EventListenersCustomizer> (0x00000000faf3abc8) thrown at [/home/abuild/rpmbuild/BUILD/icedtea-3.1.0/openjdk/hotspot/src/share/vm/classfile/systemDictionary.cpp, line 210]
Event: 57540.284 Thread 0x00007f4634bee000 Exception <a 'java/net/SocketTimeoutException': connect timed out> (0x00000000fcb2fac8) thrown at [/home/abuild/rpmbuild/BUILD/icedtea-3.1.0/openjdk/hotspot/src/share/vm/prims/jni.cpp, line 735]
Event: 57943.337 Thread 0x00007f46352da800 Implicit null exception at 0x00007f4625d42a9f to 0x00007f4625d4931d
Event: 57943.340 Thread 0x00007f4600699000 Implicit null exception at 0x00007f4625d42a9f to 0x00007f4625d4931d
Event: 58820.887 Thread 0x00007f45ea078800 Implicit null exception at 0x00007f462514eab4 to 0x00007f462514f049
Event: 61135.304 Thread 0x00007f4634dd2000 Implicit null exception at 0x00007f46258c9192 to 0x00007f46258ca9a4
Event: 61135.314 Thread 0x00007f4634dd2000 Implicit null exception at 0x00007f46256f414e to 0x00007f46256f4371
Event: 61135.315 Thread 0x00007f4634dd2000 Implicit null exception at 0x00007f4625902079 to 0x00007f4625903285
Event: 63765.574 Thread 0x00007f45f0012800 Exception <a 'java/lang/InterruptedException'> (0x00000000fb423328) thrown at [/home/abuild/rpmbuild/BUILD/icedtea-3.1.0/openjdk/hotspot/src/share/vm/runtime/objectMonitor.cpp, line 1495]
VM Arguments:
jvm_args: -Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory -Dcatalina.base=/usr/share/tomcat -Dcatalina.home=/usr/share/tomcat -Djava.endorsed.dirs= -Djava.io.tmpdir=/var/cache/tomcat/temp -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
java_command: org.apache.catalina.startup.Bootstrap start
java_class_path (initial): /usr/share/tomcat/bin/bootstrap.jar:/usr/share/tomcat/bin/tomcat-juli.jar:/usr/share/java/commons-daemon.jar
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=/usr/lib/jvm/jre
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
SHELL=/bin/sh
--------------- S Y S T E M ---------------
OS:SUSE Linux Enterprise Server 12 (x86_64)
VERSION = 12
PATCHLEVEL = 2
uname:Linux 4.4.49-92.11-default #1 SMP Fri Feb 17 08:29:30 UTC 2017 (8f9478a) x86_64
libc:glibc 2.22 NPTL 2.22
rlimit: STACK 8192k, CORE 0k, NPROC 7522, NOFILE 4096, AS infinity
load average:0.00 0.00 0.00
/proc/meminfo:
MemTotal: 1943796 kB
MemFree: 117384 kB
MemAvailable: 1056832 kB
Buffers: 8 kB
Cached: 1116816 kB
SwapCached: 3152 kB
Active: 1430656 kB
Inactive: 284260 kB
Active(anon): 438228 kB
Inactive(anon): 233656 kB
Active(file): 992428 kB
Inactive(file): 50604 kB
Unevictable: 80 kB
Mlocked: 80 kB
SwapTotal: 4187132 kB
SwapFree: 4181900 kB
Dirty: 156 kB
Writeback: 0 kB
AnonPages: 595020 kB
Mapped: 68856 kB
Shmem: 73792 kB
Slab: 75320 kB
SReclaimable: 55520 kB
SUnreclaim: 19800 kB
KernelStack: 3664 kB
PageTables: 5648 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 5159028 kB
Committed_AS: 1247032 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 0 kB
VmallocChunk: 0 kB
HardwareCorrupted: 0 kB
AnonHugePages: 471040 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 366528 kB
DirectMap2M: 1730560 kB
CPU:total 2 (1 cores per cpu, 1 threads per core) family 6 model 37 stepping 1, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, aes, clmul, tsc, tscinvbit
/proc/cpuinfo:
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 37
model name : Intel(R) Xeon(R) CPU E5645 # 2.40GHz
stepping : 1
microcode : 0x13
cpu MHz : 2400.085
cache size : 12288 KB
physical id : 0
siblings : 1
core id : 0
cpu cores : 1
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf pni pclmulqdq ssse3 cx16 sse4_1 sse4_2 x2apic popcnt aes hypervisor lahf_lm ida arat epb dtherm
bugs :
bogomips : 4800.17
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 37
model name : Intel(R) Xeon(R) CPU E5645 # 2.40GHz
stepping : 1
microcode : 0x13
cpu MHz : 2400.085
cache size : 12288 KB
physical id : 2
siblings : 1
core id : 0
cpu cores : 1
apicid : 2
initial apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf pni pclmulqdq ssse3 cx16 sse4_1 sse4_2 x2apic popcnt aes hypervisor lahf_lm ida arat epb dtherm
bugs :
bogomips : 4800.17
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:
Memory: 4k page, physical 1943796k(117384k free), swap 4187132k(4181900k free)
vm_info: OpenJDK 64-Bit Server VM (25.101-b13) for linux-amd64 JRE (1.8.0_101-b13), built on Jul 30 2016 00:00:27 by "abuild" with gcc 4.8.5
time: Sat Nov 11 13:30:04 2017
elapsed time: 243167 seconds (2d 19h 32m 47s)
Register to memory mapping:
RAX=0x0000000007114e40 is an unknown value
RBX=0x00007f463dc89420 is an unknown value
RCX=0x0000000000000000 is an unknown value
RDX=0x00007f463ce2d210: <offset 0xda8210> in /usr/lib64/jvm/java-1.8.0-openjdk-1.8.0/jre/lib/amd64/server/libjvm.so at 0x00007f463c085000
RSP=0x00007f4624cfbe00 is an unknown value
RBP=0x00007f4624cfbe10 is an unknown value
RSI=0x0000000000000032 is an unknown value
RDI=0x00007f4634018fa0 is an unknown value
R8 =0x00007f463ce69a48: <offset 0xde4a48> in /usr/lib64/jvm/java-1.8.0-openjdk-1.8.0/jre/lib/amd64/server/libjvm.so at 0x00007f463c085000
R9 =0x0000000000000001 is an unknown value
R10=0x00182e09a9af66e8 is an unknown value
R11=0x0000000000000000 is an unknown value
R12=0x0000000000000008 is an unknown value
R13=0x00007f463401b1a0 is an unknown value
R14=0x0000000000000002 is an unknown value
R15=0x00007f463ce6f3c0: <offset 0xdea3c0> in /usr/lib64/jvm/java-1.8.0-openjdk-1.8.0/jre/lib/amd64/server/libjvm.so at 0x00007f463c085000
Some background -
We are trying to run Qualcomm Atheros AR928X Wireless Network Adapter and have a crash right on driver load, following are our observations and questions.
The Atheros card "Qualcomm Atheros AR928X Wireless Network Adapter (PCI-Express) (rev 01)" is plugged into the host system (datatron).
When I attach it to the DomU - the module "ath9k" is automatically loaded, but it gives an exception "iowrite32+0x2b/0x30".
No idea what the issue is (tried also with another Atheros Card (ath10k) - similar problem). When I try an Intel card, it works.
(the card also works on the Dom0 - so the Linux driver and HW is OK).
Debugging -
After some investigation with kgdb and iommu trace on DomU it seems the iomap of PCI BAR for the device returns a a mapping f which first 0x1000 bytes are read only and that causes access violation when trying to write registers mapped to this area (all the regs with offset < 0x1000) - why this happens i still don't know. Register writes with offsets > 0x1000 are fine.
Running same driver on Dom0 is totally fine
Bellow the sigsev backtrace and xen dmesg from DomU
As can be seen there is ioremap_ of size 0x10000 starting at ffffc900402c0000 but as i said, i noticed that anything bellow ffffc900402c1000 is not writable (from gdb using set addr = val) and only readable while anything above this address is writeable.
Question -
Please give any advise on this issue and especially how to approach debugging this both on Domu and Dom0 and where in xen code to look for possible issues.
[ 37.837467] ath9k 0000:00:00.0: Xen PCI mapped GSI16 to IRQ8
[ 37.837473] pcifront pci-0: read dev=0000:00:00.0 - offset 3d size 1
[ 37.837498] pcifront pci-0: read got back value 1
[ 37.837505] pcifront pci-0: read dev=0000:00:00.0 - offset 4 size 2
[ 37.840006] pcifront pci-0: read got back value 103
[ 37.853341] pcifront pci-0: read dev=0000:00:00.0 - offset c size 1
[ 37.853374] pcifront pci-0: read got back value 8
[ 37.853383] pcifront pci-0: write dev=0000:00:00.0 - offset d size 1 val a8
[ 37.853431] pcifront pci-0: read dev=0000:00:00.0 - offset 4 size 2
[ 37.853462] pcifront pci-0: read got back value 103
[ 37.853472] pcifront pci-0: write dev=0000:00:00.0 - offset 4 size 2 val 107
[ 37.853527] pcifront pci-0: read dev=0000:00:00.0 - offset 40 size 4
[ 37.853565] pcifront pci-0: read got back value 3c25001
[ 37.853574] pcifront pci-0: write dev=0000:00:00.0 - offset 40 size 4 val 3c20001
[ 37.855784] mmiotrace: ioremap_*(0xf7b00000, 0x10000) = ffffc900402c0000
[ 37.855842] pcifront pci-0: read dev=0000:00:00.0 - offset c size 1
[ 37.855879] pcifront pci-0: read got back value 8
[ 38.301919] BUG: unable to handle kernel paging request at ffffc900402c0040
[ 38.301930] IP: [<ffffffff8132387b>] iowrite32+0x2b/0x30
[ 38.301939] PGD 3fdf4067 PUD 3e1a8067 PMD 49d7067 PTE 80100000f7b00075
[ 38.301947] Oops: 0003 [#1] SMP
[ 38.301952] Modules linked in: ath9k(OE+) ath9k_common(OE) ath9k_hw(OE) ath(OE) mac80211(E) cfg80211(E) rfkill(E) xen_pcifront(E) intel_rapl(E) x86_pkg_temp_thermal(E) coretemp(E) crct10dif_pclmul(E) crc32_pclmul(E) evdev(E) ghash_clmulni_intel(E) pcspkr(E) uio_netx(E) uio(E) autofs4(E) ext4(E) ecb(E) crc16(E) mbcache(E) jbd2(E) crc32c_generic(E) crc32c_intel(E) aesni_intel(E) xen_netfront(E) xen_blkfront(E) aes_x86_64(E) glue_helper(E) lrw(E) gf128mul(E) ablk_helper(E) cryptd(E)
[ 38.302000] CPU: 0 PID: 696 Comm: systemd-udevd Tainted: G W OE 4.5.3-dbg #2
[ 38.302008] task: ffff8800044880c0 ti: ffff8800048a8000 task.ti: ffff8800048a8000
[ 38.302015] RIP: e030:[<ffffffff8132387b>] [<ffffffff8132387b>] iowrite32+0x2b/0x30
[ 38.302024] RSP: e02b:ffff8800048ab8c8 EFLAGS: 00010196
[ 38.302029] RAX: 0000000000000000 RBX: 000000000000000e RCX: ffff88003ac34018
[ 38.302035] RDX: ffffc900402c0040 RSI: ffffc900402c0040 RDI: 0000000000000000
[ 38.302040] RBP: ffff8800048ab928 R08: 0000000000000016 R09: 0000000000000002
[ 38.302046] R10: ffffffff81b08000 R11: ffffffff81b07fc0 R12: 0000000000000016
[ 38.302051] R13: ffff880004b4d098 R14: ffff8800048abec0 R15: ffffffffc03c74c0
[ 38.302060] FS: 00007ff256fb18c0(0000) GS:ffff88003f800000(0000) knlGS:ffff88003f800000
[ 38.302068] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 38.302073] CR2: ffffc900402c0040 CR3: 0000000004a05000 CR4: 0000000000042660
[ 38.302079] Stack:
[ 38.302083] ffffffffc03a70f5 0000000000000040 ffff88003ac34018 ffffffffc0339a5b
[ 38.302092] ffff88003ac34018 ffff88003ac34068 ffff88003ac81520 0000809400008090
[ 38.302102] 0000000000008098 0000000000000000 0000000000000000 000000003c5869cf
[ 38.302111] Call Trace:
[ 38.302123] [<ffffffffc03a70f5>] ? ath9k_iowrite32+0xde/0xf5 [ath9k]
[ 38.302139] [<ffffffffc0339a5b>] ? ath9k_hw_update_mibstats+0x62/0xd6 [ath9k_hw]
[ 38.302155] [<ffffffffc033a722>] ? ath9k_enable_mib_counters+0xc2/0x119 [ath9k_hw]
[ 38.302171] [<ffffffffc033a983>] ? ath9k_hw_ani_init+0x148/0x14b [ath9k_hw]
[ 38.302182] [<ffffffffc0313b00>] ? ath9k_hw_post_init+0x104/0x16c [ath9k_hw]
[ 38.302195] [<ffffffffc0313f22>] ? __ath9k_hw_init+0x377/0x3fd [ath9k_hw]
[ 38.302206] [<ffffffffc031403e>] ? ath9k_hw_init+0x96/0xd6 [ath9k_hw]
[ 38.302218] [<ffffffffc03a877a>] ? ath9k_init_softc+0x643/0x823 [ath9k]
[ 38.302229] [<ffffffffc03a8f7d>] ? ath9k_init_device+0x43/0x21d [ath9k]
[ 38.302243] [<ffffffffc03aad2e>] ? ath9k_tasklet+0x462/0x462 [ath9k]
[ 38.302255] [<ffffffffc03c1638>] ? ath_pci_probe+0x2c8/0x38f [ath9k]
[ 38.302263] [<ffffffff815bab16>] ? _raw_spin_unlock_irqrestore+0x16/0x20
[ 38.302271] [<ffffffff814431a4>] ? __pm_runtime_resume+0x54/0x70
[ 38.302278] [<ffffffff813566ff>] ? local_pci_probe+0x3f/0x90
[ 38.302284] [<ffffffff81357ab0>] ? pci_device_probe+0x100/0x140
[ 38.302290] [<ffffffff8143853c>] ? driver_probe_device+0x21c/0x430
[ 38.302296] [<ffffffff814387cb>] ? __driver_attach+0x7b/0x80
[ 38.302301] [<ffffffff81438750>] ? driver_probe_device+0x430/0x430
[ 38.302308] [<ffffffff81436007>] ? bus_for_each_dev+0x67/0xb0
[ 38.302313] [<ffffffff8143773f>] ? bus_add_driver+0x1df/0x270
[ 38.302319] [<ffffffffc02f0000>] ? 0xffffffffc02f0000
[ 38.302324] [<ffffffff81438fe7>] ? driver_register+0x57/0xc0
[ 38.302334] [<ffffffffc03c19ad>] ? ath_pci_init+0x23/0x25 [ath9k]
[ 38.302345] [<ffffffffc02f000d>] ? ath9k_init+0xd/0x1000 [ath9k]
[ 38.302352] [<ffffffff81002122>] ? do_one_initcall+0xb2/0x200
[ 38.302358] [<ffffffff815b74d4>] ? preempt_schedule_common+0x14/0x30
[ 38.302363] [<ffffffff815b7509>] ? _cond_resched+0x19/0x20
[ 38.302371] [<ffffffff811cf032>] ? kmem_cache_alloc_trace+0x82/0x220
[ 38.302378] [<ffffffff8116d58a>] ? do_init_module+0x5b/0x1ce
[ 38.302384] [<ffffffff810fa676>] ? load_module+0x2146/0x2790
[ 38.302389] [<ffffffff810f71d0>] ? __symbol_put+0x60/0x60
[ 38.302395] [<ffffffff810f7628>] ? copy_module_from_fd.isra.51+0xf8/0x140
[ 38.302401] [<ffffffff810faed8>] ? SYSC_finit_module+0xa8/0xd0
[ 38.302408] [<ffffffff815bb072>] ? system_call_fast_compare_end+0xc/0x67
[ 38.302413] Code: 48 81 fe ff ff 03 00 48 89 f2 77 1f 48 81 fe 00 00 01 00 76 07 0f b7 d6 89 f8 ef c3 48 c7 c6 df 6a 84 81 48 89 d7 e9 85 fe ff ff <89> 3e c3 66 90 48 81 ff ff ff 03 00 77 28 48 81 ff 00 00 01 00
[ 38.302460] RIP [<ffffffff8132387b>] iowrite32+0x2b/0x30
[ 38.302466] RSP <ffff8800048ab8c8>
[ 38.302469] CR2: ffffc900402c0040
[ 38.302475] ---[ end trace 092ecee276c2da16 ]---
(XEN) Xen version 4.6.0 (Debian 4.6.0-1+nmu2) (ijc#debian.org) (gcc (Debian 5.3.1-8) 5.3.1 20160205) debug=n Tue Feb 9 17:46:27 UTC 2016
(XEN) Bootloader: GRUB 2.02~beta2-36
(XEN) Command line: placeholder log_lvl=all loglvl=all guest_loglvl=all iommu=verbose
(XEN) Video information:
(XEN) VGA is text mode 80x25, font 8x16
(XEN) VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN) EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN) Found 3 MBR signatures
(XEN) Found 3 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) 0000000000000000 - 0000000000099c00 (usable)
(XEN) 0000000000099c00 - 00000000000a0000 (reserved)
(XEN) 00000000000e0000 - 0000000000100000 (reserved)
(XEN) 0000000000100000 - 0000000020000000 (usable)
(XEN) 0000000020000000 - 0000000020200000 (reserved)
(XEN) 0000000020200000 - 0000000040004000 (usable)
(XEN) 0000000040004000 - 0000000040005000 (reserved)
(XEN) 0000000040005000 - 00000000d9d01000 (usable)
(XEN) 00000000d9d01000 - 00000000da191000 (reserved)
(XEN) 00000000da191000 - 00000000da192000 (ACPI data)
(XEN) 00000000da192000 - 00000000da2af000 (ACPI NVS)
(XEN) 00000000da2af000 - 00000000da6da000 (reserved)
(XEN) 00000000da6da000 - 00000000da6db000 (usable)
(XEN) 00000000da6db000 - 00000000da71e000 (ACPI NVS)
(XEN) 00000000da71e000 - 00000000daddf000 (usable)
(XEN) 00000000daddf000 - 00000000daff2000 (reserved)
(XEN) 00000000daff2000 - 00000000db000000 (usable)
(XEN) 00000000db800000 - 00000000dfa00000 (reserved)
(XEN) 00000000f8000000 - 00000000fc000000 (reserved)
(XEN) 00000000fec00000 - 00000000fec01000 (reserved)
(XEN) 00000000fed00000 - 00000000fed04000 (reserved)
(XEN) 00000000fed1c000 - 00000000fed20000 (reserved)
(XEN) 00000000fee00000 - 00000000fee01000 (reserved)
(XEN) 00000000ff000000 - 0000000100000000 (reserved)
(XEN) 0000000100000000 - 000000041e600000 (usable)
(XEN) ACPI: RSDP 000F0490, 0024 (r2 ALASKA)
(XEN) ACPI: XSDT DA2A0080, 007C (r1 ALASKA A M I 1072009 AMI 10013)
(XEN) ACPI: FACP DA2A9C58, 00F4 (r4 ALASKA A M I 1072009 AMI 10013)
(XEN) ACPI: DSDT DA2A0190, 9AC5 (r2 ALASKA A M I 1 INTL 20051117)
(XEN) ACPI: FACS DA2ADF80, 0040
(XEN) ACPI: APIC DA2A9D50, 0092 (r3 ALASKA A M I 1072009 AMI 10013)
(XEN) ACPI: FPDT DA2A9DE8, 0044 (r1 ALASKA A M I 1072009 AMI 10013)
(XEN) ACPI: MCFG DA2A9E30, 003C (r1 ALASKA A M I 1072009 MSFT 97)
(XEN) ACPI: HPET DA2A9E70, 0038 (r1 ALASKA A M I 1072009 AMI. 5)
(XEN) ACPI: SSDT DA2A9EA8, 036D (r1 SataRe SataTabl 1000 INTL 20091112)
(XEN) ACPI: SSDT DA2AA218, 08A2 (r1 PmRef Cpu0Ist 3000 INTL 20051117)
(XEN) ACPI: SSDT DA2AAAC0, 0A92 (r1 PmRef CpuPm 3000 INTL 20051117)
(XEN) ACPI: DMAR DA2AB558, 00B8 (r1 INTEL SNB 1 INTL 1)
(XEN) ACPI: ASF! DA2AB610, 00A5 (r32 INTEL HCG 1 TFSM F4240)
(XEN) ACPI: BGRT DA2AB6B8, 0038 (r0 ALASKA A M I 1072009 AMI 10013)
(XEN) System RAM: 16263MB (16653732kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-000000041e600000
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000fd7e0
(XEN) DMI 2.7 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x408
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:404,1:0], pm1x_evt[1:400,1:0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - da2adf80/0000000000000000, using 32
(XEN) ACPI: wakeup_vec[da2adf8c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) Processor #0 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) Processor #2 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
(XEN) Processor #4 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)
(XEN) Processor #6 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x01] enabled)
(XEN) Processor #1 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x03] enabled)
(XEN) Processor #3 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x05] enabled)
(XEN) Processor #5 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x07] enabled)
(XEN) Processor #7 7:10 APIC version 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode: Flat. Using 1 I/O APICs
(XEN) ACPI: HPET id: 0x8086a701 base: 0xfed00000
(XEN) ERST table was not found
(XEN) ACPI: BGRT: invalidating v1 image at 0xce4c7018
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 8 CPUs (0 hotplug CPUs)
(XEN) IRQ limits: 24 GSI, 1528 MSI/MSI-X
(XEN) Switched to APIC driver x2apic_cluster.
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) Intel machine check reporting enabled
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2292.620 MHz processor.
(XEN) Initing memory sharing.
(XEN) alt table ffff82d0802bd010 -> ffff82d0802be240
(XEN) PCI: MCFG configuration 0: base f8000000 segment 0000 buses 00 - 3f
(XEN) PCI: MCFG area at f8000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-3f
(XEN) Intel VT-d iommu 0 supported page sizes: 4kB.
(XEN) Intel VT-d iommu 1 supported page sizes: 4kB.
(XEN) Intel VT-d Snoop Control not enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping enabled.
(XEN) Intel VT-d Shared EPT tables not enabled.
(XEN) I/O virtualisation enabled
(XEN) - Dom0 mode: Relaxed
(XEN) Interrupt remapping enabled
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) ENABLING IO-APIC IRQs
(XEN) -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) TSC deadline timer enabled
(XEN) Platform timer is 14.318MHz HPET
(XEN) Allocated console ring of 64 KiB.
(XEN) mwait-idle: MWAIT substates: 0x21120
(XEN) mwait-idle: v0.4 model 0x3a
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) VMX: Supported advanced features:
(XEN) - APIC MMIO access virtualisation
(XEN) - APIC TPR shadow
(XEN) - Extended Page Tables (EPT)
(XEN) - Virtual-Processor Identifiers (VPID)
(XEN) - Virtual NMI
(XEN) - MSR direct-access bitmap
(XEN) - Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB
(XEN) Brought up 8 CPUs
(XEN) ACPI sleep modes: S3
(XEN) VPMU: disabled
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) Dom0 has maximum 792 PIRQs
(XEN) NX (Execute Disable) protection active
(XEN) *** LOADING DOMAIN 0 ***
(XEN) Xen kernel: 64-bit, lsb, compat32
(XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1d59000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) Dom0 alloc.: 000000040e000000->0000000410000000 (4062057 pages to be allocated)
(XEN) Init. ramdisk: 000000041d4d6000->000000041e5ff665
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN) Loaded kernel: ffffffff81000000->ffffffff81d59000
(XEN) Init. ramdisk: 0000000000000000->0000000000000000
(XEN) Phys-Mach map: 0000008000000000->0000008001f16498
(XEN) Start info: ffffffff81d59000->ffffffff81d594b4
(XEN) Page tables: ffffffff81d5a000->ffffffff81d6d000
(XEN) Boot stack: ffffffff81d6d000->ffffffff81d6e000
(XEN) TOTAL: ffffffff80000000->ffffffff82000000
(XEN) ENTRY ADDRESS: ffffffff81b2b1f0
(XEN) Dom0 has maximum 8 VCPUs
(XEN) Bogus DMIBAR 0xfed18001 on 0000:00:00.0
(XEN) Scrubbing Free RAM on 1 nodes using 4 CPUs
(XEN) .................................done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 288kB init memory.
(XEN) Bogus DMIBAR 0xfed18001 on 0000:00:00.0
(XEN) PCI add device 0000:00:00.0
(XEN) PCI add device 0000:00:01.0
(XEN) PCI add device 0000:00:02.0
(XEN) PCI add device 0000:00:14.0
(XEN) PCI add device 0000:00:16.0
(XEN) PCI add device 0000:00:16.3
(XEN) PCI add device 0000:00:19.0
(XEN) PCI add device 0000:00:1a.0
(XEN) PCI add device 0000:00:1b.0
(XEN) PCI add device 0000:00:1c.0
(XEN) PCI add device 0000:00:1c.1
(XEN) PCI add device 0000:00:1c.2
(XEN) PCI add device 0000:00:1c.4
(XEN) PCI add device 0000:00:1d.0
(XEN) PCI add device 0000:00:1f.0
(XEN) PCI add device 0000:00:1f.2
(XEN) PCI add device 0000:00:1f.3
(XEN) PCI add device 0000:01:00.0
(XEN) PCI phantom 0000:01:00.4
(XEN) PCI add device 0000:02:00.0
(XEN) PCI add device 0000:03:00.0
(XEN) PCI add device 0000:04:00.0
(XEN) PCI add device 0000:05:00.0
(XEN) PCI add device 0000:06:00.0
root#debian-guest-01:~# cat /proc/iomem
00000000-00000fff : reserved
00001000-0009ffff : System RAM
000a0000-000fffff : reserved
000f0000-000fffff : System ROM
00100000-3fffffff : System RAM
01000000-015bfd4c : Kernel code
015bfd4d-01b127ff : Kernel data
01c65000-01d3dfff : Kernel bss
f7b00000-f7b0ffff : 0000:00:00.0
f7b00000-f7b0ffff : ath9k
fee00000-fee00fff : Local APIC
root#debian-guest-01:~# lspci -vvvxxx
00:00.0 Network controller: Qualcomm Atheros AR928X Wireless Network Adapter (PCI-Express) (rev 01)
Subsystem: Qualcomm Atheros AR928X Wireless Network Adapter (PCI-Express)
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 32 bytes
Interrupt: pin A routed to IRQ 25
Region 0: Memory at f7b00000 (64-bit, non-prefetchable) [size=64K]
Capabilities: [40] Power Management version 2
Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit-
Address: 00000000 Data: 0000
Capabilities: [60] Express (v1) Legacy Endpoint, MSI 00
DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset-
DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L1, Exit Latency L0s <512ns, L1 <64us
ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
LnkCtl: ASPM Disabled; RCB 128 bytes Disabled- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
Capabilities: [90] MSI-X: Enable- Count=1 Masked-
Vector table: BAR=0 offset=00000000
PBA: BAR=0 offset=00000000
Capabilities: [100 v1] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
Capabilities: [140 v1] Virtual Channel
Caps: LPEVC=0 RefClk=100ns PATEntryBits=1
Arb: Fixed- WRR32- WRR64- WRR128-
Ctrl: ArbSelect=Fixed
Status: InProgress-
VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
Arb: Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=01
Status: NegoPending- InProgress-
Capabilities: [160 v1] Device Serial Number 00-00-00-00-00-00-00-00
Kernel driver in use: ath9k
Kernel modules: ath9k