ORA-600内部错误司空见惯了，这个ORA-610的内部错误还是第一次见到。
完整的相关错误信息如下：
Wed Jun 22 10:01:08 2011 Errors IN file /oracle10g/admin/orcl/bdump/orcl_ora_27376.trc: ORA-00610: Internal error code Wed Jun 22 10:02:16 2011 WARNING: inbound connection timed OUT (ORA-3136) Wed Jun 22 10:05:02 2011 Process J000 died, see its trace file Wed Jun 22 10:05:07 2011 kkjcre1p: unable TO spawn jobq slave process Wed Jun 22 10:05:07 2011 Errors IN file /oracle10g/admin/orcl/bdump/orcl_cjq0_12889.trc: Wed Jun 22 10:07:21 2011 WARNING: inbound connection timed OUT (ORA-3136) Wed Jun 22 10:20:58 2011 Errors IN file /oracle10g/admin/orcl/udump/orcl_ora_27414.trc: ORA-27102: OUT OF memory HPUX-ia64 Error: 12: NOT enough SPACE Additional information: 108 Additional information: 458752 Wed Jun 22 10:20:59 2011 Errors IN file /oracle10g/admin/orcl/udump/orcl_ora_27414.trc: ORA-07445: exception encountered: core dump [kghalf()+624] [SIGSEGV] [Address NOT mapped TO object] [0xFFFFFFFFFFFFFFF0] [] [] ORA-27102: OUT OF memory HPUX-ia64 Error: 12: NOT enough SPACE Additional information: 108 Additional information: 458752 Wed Jun 22 10:21:03 2011 Errors IN file /oracle10g/admin/orcl/udump/orcl_ora_27414.trc: ORA-04030: OUT OF process memory WHEN trying TO allocate 753136 bytes (pga heap,kco buffer) ORA-07445: exception encountered: core dump [kghalf()+624] [SIGSEGV] [Address NOT mapped TO object] [0xFFFFFFFFFFFFFFF0] [] [] ORA-27102: OUT OF memory HPUX-ia64 Error: 12: NOT enough SPACE Additional information: 108 Additional information: 458752 Wed Jun 22 10:21:03 2011 Errors IN file /oracle10g/admin/orcl/udump/orcl_ora_27414.trc: ORA-00081: address range [0x6000000000127430, 0x6000000000127434) IS NOT readable ORA-07445: exception encountered: core dump [kghalf()+624] [SIGSEGV] [Address NOT mapped TO object] [0xFFFFFFFFFFFFFFF0] [] [] ORA-27102: OUT OF memory HPUX-ia64 Error: 12: NOT enough SPACE Additional information: 108 Additional information: 458752 Wed Jun 22 10:21:37 2011 Errors IN file /oracle10g/admin/orcl/udump/orcl_ora_7454.trc: ORA-27103: internal error HPUX-ia64 Error: 28: No SPACE LEFT ON device Additional information: 108 Additional information: 262144 Additional information: -444973056 Wed Jun 22 10:21:39 2011 Errors IN file /oracle10g/admin/orcl/udump/orcl_ora_7454.trc: ORA-04030: OUT OF process memory WHEN trying TO allocate 753136 bytes (pga heap,kco buffer) ORA-27103: internal error HPUX-ia64 Error: 28: No SPACE LEFT ON device Additional information: 108 Additional information: 262144 Additional information: -444973056 |
从错误信息上看，在出现ORA-610错误后，很快JOB进程死到，随后系统spawn新的JOB进程时报错，然后就是ORA-27102内部不足的错误，并引发了ORA-7445[kghalf]的错误，以及操作系统上的错误以及ORA-27103以及ORA-4030错误。
仅从现有的错误信息上分析，应该是一个JOB进程运行消耗资源较多的SQL，导致PGA不足，而Oracle尝试从SWAP空间分配内存，但是SWAP空间不足，从而导致了这个问题。
在MOS文档ORA-00610 And/Or “unable to spawn jobq slave process ” And/Or “Process(<>) creation failed” In The Alert Log And/Or TNS-12518/ TNS-12500 In Listener Log [ID 416244.1]中描述了这个问题，导致问题的原因是由于缺少操作系统资源所致，而导致这种内存不足错误的原因多半是由于SWAP空间不足所致。