I'm running SystemTap on ArchLinux 4.7.4-1, with the rebuilt kernel as instructed on ArchLinux Wiki. The version of SystemTap is:
$ stap -V
Systemtap translator/driver (version 3.0/0.167, non-git sources)
Copyright (C) 2005-2015 Red Hat, Inc. and others
This is free software; see the source for copying conditions.
enabled features: AVAHI LIBSQLITE3 LIBXML2 NLS NSS TR1_UNORDERED_MAP READLINE
$ uname -a
Linux eva-dummy 4.7.4-1-ARCH #1 SMP PREEMPT Sun Sep 25 14:32:13 EDT 2016 x86_64 GNU/Linux
I have the SystemTap script:
#!/usr/bin/stap
probe kernel.function("*#net/socket.c").call
{
printf ("%s -> %s\n", thread_indent(1), probefunc())
}
probe kernel.function("*#net/socket.c").return
{
printf ("%s <- %s\n", thread_indent(-1), probefunc())
}
The output of running with -vvv option is:
$ stap -vvv hello-world.stp
Systemtap translator/driver (version 3.0/0.167, non-git sources)
Copyright (C) 2005-2015 Red Hat, Inc. and others
This is free software; see the source for copying conditions.
enabled features: AVAHI LIBSQLITE3 LIBXML2 NLS NSS TR1_UNORDERED_MAP READLINE
Created temporary directory "/tmp/stap4mY4hm"
Session arch: x86_64 release: 4.7.4-1-ARCH
Parsed kernel "/lib/modules/4.7.4-1-ARCH/build/.config", containing 5396 tuples
Parsed kernel "/lib/modules/4.7.4-1-ARCH/build/Module.symvers", containing 7295 vmlinux exports
Kernel symbol table /lib/modules/4.7.4-1-ARCH/build/System.map unavailable, (No such file or directory)
Parsed kernel "/boot/System.map-4.7.4-1-ARCH", containing 32456 symbols
Processing tapset "/usr/share/systemtap/tapset/linux/context.stpm"
Processing tapset "/usr/share/systemtap/tapset/linux/json.stpm"
Processing tapset "/usr/share/systemtap/tapset/linux/nfs_proc.stpm"
Processing tapset "/usr/share/systemtap/tapset/linux/syscalls.stpm"
Processing tapset "/usr/share/systemtap/tapset/linux/task.stpm"
Searched for library macro files: "/usr/share/systemtap/tapset/linux/*.stpm", found: 5, processed: 5
Processing tapset "/usr/share/systemtap/tapset/choose_defined.stpm"
Processing tapset "/usr/share/systemtap/tapset/container_of.stpm"
Processing tapset "/usr/share/systemtap/tapset/macros.stpm"
Processing tapset "/usr/share/systemtap/tapset/offsetof.stpm"
Processing tapset "/usr/share/systemtap/tapset/print_stats.stpm"
Processing tapset "/usr/share/systemtap/tapset/private30.stpm"
Processing tapset "/usr/share/systemtap/tapset/try_assign.stpm"
Processing tapset "/usr/share/systemtap/tapset/type_defined.stpm"
Searched for library macro files: "/usr/share/systemtap/tapset/*.stpm", found: 8, processed: 8
Processing tapset "/usr/share/systemtap/tapset/linux/x86_64/aux_syscalls.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/x86_64/nd_syscalls.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/x86_64/syscalls.stp"
Searched: "/usr/share/systemtap/tapset/linux/x86_64/*.stp", found: 3, processed: 3
Processing tapset "/usr/share/systemtap/tapset/linux/atomic.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/aux_syscalls.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/context-caller.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/context-envvar.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/context.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/context-symbols.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/context-unwind.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/conversions-guru.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/conversions.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ctime.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/dentry.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/dev.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/endian.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/guru-delay.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/guru-signal.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/inet_sock.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/inet.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ioblock.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ioscheduler.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ipmib-filter-default.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ipmib.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ip.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/irq.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/json.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/kprocess.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/kretprobe.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/linuxmib-filter-default.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/linuxmib.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/loadavg.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/logging.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/memory.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/nd_syscalls2.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/nd_syscalls.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/netfilter.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/networking.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/nfsderrno.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/nfsd.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/nfs_proc.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/nfs.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/panic.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/perf.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/proc_mem.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/pstrace.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/rcu.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/rlimit.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/rpc.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/scheduler.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/scsi.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/signal.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/socket.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/syscalls2.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/syscalls_cfg_trunc.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/syscalls.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/target_set.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/task_ancestry.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/task.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/task_time.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/tcpmib-filter-default.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/tcpmib.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/tcp.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/timestamp_gtod.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/timestamp_monotonic.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/timestamp.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/tty.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/tzinfo.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ucontext.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ucontext-symbols.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/ucontext-unwind.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/udp.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/utrace.stp"
Processing tapset "/usr/share/systemtap/tapset/linux/vfs.stp"
Searched: "/usr/share/systemtap/tapset/linux/*.stp", found: 71, processed: 71
Processing tapset "/usr/share/systemtap/tapset/x86_64/registers.stp"
Searched: "/usr/share/systemtap/tapset/x86_64/*.stp", found: 1, processed: 1
Processing tapset "/usr/share/systemtap/tapset/ansi.stp"
Processing tapset "/usr/share/systemtap/tapset/argv.stp"
Processing tapset "/usr/share/systemtap/tapset/context.stp"
Processing tapset "/usr/share/systemtap/tapset/errno.stp"
Processing tapset "/usr/share/systemtap/tapset/indent-default.stp"
Processing tapset "/usr/share/systemtap/tapset/indent.stp"
Processing tapset "/usr/share/systemtap/tapset/init.stp"
Processing tapset "/usr/share/systemtap/tapset/java.stp"
Processing tapset "/usr/share/systemtap/tapset/logging.stp"
Processing tapset "/usr/share/systemtap/tapset/null.stp"
Processing tapset "/usr/share/systemtap/tapset/oneshot.stp"
Processing tapset "/usr/share/systemtap/tapset/pn.stp"
Processing tapset "/usr/share/systemtap/tapset/queue_stats.stp"
Processing tapset "/usr/share/systemtap/tapset/random.stp"
Processing tapset "/usr/share/systemtap/tapset/registers.stp"
Processing tapset "/usr/share/systemtap/tapset/speculative.stp"
Processing tapset "/usr/share/systemtap/tapset/stap_staticmarkers.stp"
Processing tapset "/usr/share/systemtap/tapset/stopwatch.stp"
Processing tapset "/usr/share/systemtap/tapset/string.stp"
Processing tapset "/usr/share/systemtap/tapset/switchfile.stp"
Processing tapset "/usr/share/systemtap/tapset/system.stp"
Processing tapset "/usr/share/systemtap/tapset/timers.stp"
Processing tapset "/usr/share/systemtap/tapset/tokenize.stp"
Processing tapset "/usr/share/systemtap/tapset/tzinfo.stp"
Processing tapset "/usr/share/systemtap/tapset/uconversions.stp"
Searched: "/usr/share/systemtap/tapset/*.stp", found: 25, processed: 25
Pass 1: parsed user script and 113 library scripts using 116784virt/38632res/6676shr/32184data kb, in 100usr/0sys/239real ms.
Attempting to extract kernel debuginfo build ID from /lib/modules/4.7.4-1-ARCH/build/vmlinux.id
Attempting to extract kernel debuginfo build ID from /sys/kernel/notes
blacklist regexps:
blfn: ^(atomic_notifier_call_chain|default_do_nmi|__die|die_nmi|do_debug|do_general_protection|do_int3|do_IRQ|do_page_fault|do_sparc64_fault|do_trap|dummy_nmi_callback|flush_icache_range|ia64_bad_break|ia64_do_page_fault|ia64_fault|io_check_error|mem_parity_error|nmi_watchdog_tick|notifier_call_chain|oops_begin|oops_end|program_check_exception|single_step_exception|sync_regs|unhandled_fault|unknown_nmi_error|xen_[gs]et_debugreg|xen_irq_.*|xen_.*_fl_direct.*|check_events|xen_adjust_exception_frame|xen_iret.*|xen_sysret64.*|test_ti_thread_flag.*|inat_get_opcode_attribute|system_call_after_swapgs|HYPERVISOR_[gs]et_debugreg|HYPERVISOR_event_channel_op|hash_64|hash_ptr|native_set_pte|.*raw_.*_lock.*|.*raw_.*_unlock.*|.*raw_.*_trylock.*|.*read_lock.*|.*read_unlock.*|.*read_trylock.*|.*write_lock.*|.*write_unlock.*|.*write_trylock.*|.*write_seqlock.*|.*write_sequnlock.*|.*spin_lock.*|.*spin_unlock.*|.*spin_trylock.*|.*spin_is_locked.*|rwsem_.*lock.*|.*mutex_.*lock.*|raw_.*|atomic_.*|atomic64_.*|get_bh|put_bh|.*apic.*|.*APIC.*|.*softirq.*|.*IRQ.*|.*_intr.*|__delay|.*kernel_text.*|get_current|current_.*|.*exception_tables.*|.*setup_rt_frame.*|.*preempt_count.*|preempt_schedule|__switch_to|special_mapping_.*|.*_pte_.*)$
blfn_ret: ^(do_exit|sys_exit|sys_exit_group)$
blfile: ^(kernel/kprobes\.c|arch/.*/kernel/kprobes\.c|.*/include/asm/io\.h|.*/include/asm/io-defs\.h|.*/include/asm/io_64\.h|.*/include/asm/bitops\.h|drivers/ide/ide-iops\.c|arch/.*/kernel/paravirt\.c|.*/include/asm/paravirt\.h|fs/seq_file\.c)$
blsection: ^(\.init\.|\.exit\.|\.devinit\.|\.devexit\.|\.cpuinit\.|\.cpuexit\.|\.meminit\.|\.memexit\.)
parse '*#net/socket.c', func '*', file 'net/socket.c'
focused on module 'kernel' = [0xffffffff81000000-0xffffffff81b7e000, bias 0 file /lib/modules/4.7.4-1-ARCH/build/vmlinux ELF machine |x86_64 (code 62)
focused on module 'kernel'
selected source file 'net/socket.c'
suggesting 29554 dwarf functions from modules:
kernel
semantic error: while resolving probe point: identifier 'kernel' at hello-world.stp:3:7
thrown from: elaborate.cxx:1068
source: probe kernel.function("*#net/socket.c").call
^
semantic error: no match (similar functions: f, lf, up, die, gcd)
thrown from: tapsets.cxx:8329
parse '*#net/socket.c', func '*', file 'net/socket.c'
focused on module 'kernel' = [0xffffffff81000000-0xffffffff81b7e000, bias 0 file /lib/modules/4.7.4-1-ARCH/build/vmlinux ELF machine |x86_64 (code 62)
focused on module 'kernel'
selected source file 'net/socket.c'
suggesting 29554 dwarf functions from modules:
kernel
semantic error: while resolving probe point: identifier 'kernel' at :8:7
thrown from: elaborate.cxx:1068
source: probe kernel.function("*#net/socket.c").return
^
semantic error: no match (similar functions: f, lf, up, die, gcd)
thrown from: tapsets.cxx:8329
Pass 2: analyzed script: 0 probes, 0 functions, 0 embeds, 0 globals using 118068virt/41172res/7648shr/33468data kb, in 560usr/20sys/967real ms.
Pass 2: analysis failed. [man error::pass2]
Running rm -rf /tmp/stap4mY4hm
Spawn waitpid result (0x0): 0
Removed temporary directory "/tmp/stap4mY4hm"
It seems that SystemTap cannot recognize the kernel.xxxx probes. How to make the script run successfully on ArchLinux?
Related
I am doing bulk load in Hbase But getting error while loading Hfiles.
11:02:49.909 ERROR org.apache.hadoop.hbase.tool.LoadIncrementalHFiles - -------------------------------------------------
Bulk load aborted with some files not yet loaded:
-------------------------------------------------
hdfs://10.13.10.19:8020/madhuri/userOutput/personalDetails/6255a0ffd4e14f70ad2146bb756f004c
java.io.IOException: Retry attempted 10 times without completing, bailing out
at org.apache.hadoop.hbase.tool.LoadIncrementalHFiles.performBulkLoad(LoadIncrementalHFiles.java:420)
at org.apache.hadoop.hbase.tool.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:343)
at org.apache.hadoop.hbase.tool.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:256)
at com.clouds.dbtest.test.HbaseBulkLoad.doBulkLoad(HbaseBulkLoad.java:26)
at com.clouds.dbtest.test.HBaseBulkLoadDriver.run(HBaseBulkLoadDriver.java:84)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at com.clouds.dbtest.test.HBaseBulkLoadDriver.main(HBaseBulkLoadDriver.java:41)
I have taken code from link.
Trying to run nvidia’s deepstream5.0 sdk (sample program) on ubuntu 18.04 by following the document (DeepStream Development Guide — DeepStream DeepStream Version: 5.0 documentation).
Hardware Platform (Jetson / GPU)=GPU NVIDIA GEFORCE RTX 2060
TensorRT Version=7.0
NVIDIA GPU Driver Version (valid for GPU only):450.102
Issue Type( questions, new requirements, bugs)=bugs
GCC=7.5
PYTHON 3.7
CUDNN 7.6.5
CUDA 10.2
The application is installed in the path: “/opt/nvidia/deepstream/deepstream-5.0/”.
The execution command is "deepstream-app -c "
Example:
deepstream-app -c /opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/source30_1080p_dec_infer-resnet_tiled_display_int8.txt
However got segmentation fault just after opening a blank screen and closing suddenly
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1523 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_CarMake/resnet18.caffemodel_b16_gpu0_int8.engine open error
0:00:01.788894483 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_2> NvDsInferContext[UID 6]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1690> [UID = 6]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_CarMake/resnet18.caffemodel_b16_gpu0_int8.engine failed
0:00:01.788911328 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_2> NvDsInferContext[UID 6]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1797> [UID = 6]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_CarMake/resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild
0:00:01.788917862 9829 0x5594636fc490 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<secondary_gie_2> NvDsInferContext[UID 6]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 6]: Trying to create engine from model files
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Reading Calibration Cache for calibrator: EntropyCalibration2
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Generated calibration scales using calibration cache. Make sure that calibration cache has latest scales.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: To regenerate calibration cache, please delete the existing one. TensorRT will generate a new calibration cache.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Detected 1 inputs and 1 output network tensors.
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1495 Serialize engine failed because of file path: /opt/nvidia/deepstream/deepstream-5.0/samples/models/Secondary_CarMake/resnet18.caffemodel_b16_gpu0_int8.engine opened error
0:00:11.045161759 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_2> NvDsInferContext[UID 6]: Warning from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1743> [UID = 6]: failed to serialize cude engine to file: /opt/nvidia/deepstream/deepstream-5.0/samples/models/Secondary_CarMake/resnet18.caffemodel_b16_gpu0_int8.engine
WARNING: …/nvdsinfer/nvdsinfer_func_utils.cpp:36 [TRT]: Current optimization profile is: 0. Please ensure there are no enqueued operations pending in this context prior to switching profiles
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:685 [Implicit Engine Info]: layers num: 2
0 INPUT kFLOAT input_1 3x224x224
1 OUTPUT kFLOAT predictions/Softmax 20x1x1
0:00:11.054222978 9829 0x5594636fc490 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<secondary_gie_2> [UID 6]: Load new model:/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/config_infer_secondary_carmake.txt sucessfully
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1523 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_CarColor/resnet18.caffemodel_b16_gpu0_int8.engine open error
0:00:11.054352982 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_1> NvDsInferContext[UID 5]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1690> [UID = 5]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_CarColor/resnet18.caffemodel_b16_gpu0_int8.engine failed
0:00:11.054360902 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_1> NvDsInferContext[UID 5]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1797> [UID = 5]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_CarColor/resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild
0:00:11.054365641 9829 0x5594636fc490 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<secondary_gie_1> NvDsInferContext[UID 5]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 5]: Trying to create engine from model files
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Reading Calibration Cache for calibrator: EntropyCalibration2
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Generated calibration scales using calibration cache. Make sure that calibration cache has latest scales.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: To regenerate calibration cache, please delete the existing one. TensorRT will generate a new calibration cache.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Detected 1 inputs and 1 output network tensors.
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1495 Serialize engine failed because of file path: /opt/nvidia/deepstream/deepstream-5.0/samples/models/Secondary_CarColor/resnet18.caffemodel_b16_gpu0_int8.engine opened error
0:00:19.492522201 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_1> NvDsInferContext[UID 5]: Warning from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1743> [UID = 5]: failed to serialize cude engine to file: /opt/nvidia/deepstream/deepstream-5.0/samples/models/Secondary_CarColor/resnet18.caffemodel_b16_gpu0_int8.engine
WARNING: …/nvdsinfer/nvdsinfer_func_utils.cpp:36 [TRT]: Current optimization profile is: 0. Please ensure there are no enqueued operations pending in this context prior to switching profiles
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:685 [Implicit Engine Info]: layers num: 2
0 INPUT kFLOAT input_1 3x224x224
1 OUTPUT kFLOAT predictions/Softmax 12x1x1
0:00:19.497783953 9829 0x5594636fc490 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<secondary_gie_1> [UID 5]: Load new model:/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/config_infer_secondary_carcolor.txt sucessfully
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1523 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_VehicleTypes/resnet18.caffemodel_b16_gpu0_int8.engine open error
0:00:19.497944601 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_0> NvDsInferContext[UID 4]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1690> [UID = 4]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_VehicleTypes/resnet18.caffemodel_b16_gpu0_int8.engine failed
0:00:19.497954066 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_0> NvDsInferContext[UID 4]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1797> [UID = 4]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Secondary_VehicleTypes/resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild
0:00:19.497959157 9829 0x5594636fc490 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<secondary_gie_0> NvDsInferContext[UID 4]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 4]: Trying to create engine from model files
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Reading Calibration Cache for calibrator: EntropyCalibration2
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Generated calibration scales using calibration cache. Make sure that calibration cache has latest scales.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: To regenerate calibration cache, please delete the existing one. TensorRT will generate a new calibration cache.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Detected 1 inputs and 1 output network tensors.
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1495 Serialize engine failed because of file path: /opt/nvidia/deepstream/deepstream-5.0/samples/models/Secondary_VehicleTypes/resnet18.caffemodel_b16_gpu0_int8.engine opened error
0:00:27.394531547 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<secondary_gie_0> NvDsInferContext[UID 4]: Warning from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1743> [UID = 4]: failed to serialize cude engine to file: /opt/nvidia/deepstream/deepstream-5.0/samples/models/Secondary_VehicleTypes/resnet18.caffemodel_b16_gpu0_int8.engine
WARNING: …/nvdsinfer/nvdsinfer_func_utils.cpp:36 [TRT]: Current optimization profile is: 0. Please ensure there are no enqueued operations pending in this context prior to switching profiles
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:685 [Implicit Engine Info]: layers num: 2
0 INPUT kFLOAT input_1 3x224x224
1 OUTPUT kFLOAT predictions/Softmax 6x1x1
0:00:27.401846636 9829 0x5594636fc490 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<secondary_gie_0> [UID 4]: Load new model:/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/config_infer_secondary_vehicletypes.txt sucessfully
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-5.0/lib/libnvds_mot_klt.so
gstnvtracker: Optional NvMOT_RemoveStreams not implemented
gstnvtracker: Batch processing is OFF
gstnvtracker: Past frame output is OFF
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1523 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Primary_Detector/resnet10.caffemodel_b4_gpu0_int8.engine open error
0:00:27.405130601 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1690> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Primary_Detector/resnet10.caffemodel_b4_gpu0_int8.engine failed
0:00:27.405139410 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1797> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Primary_Detector/resnet10.caffemodel_b4_gpu0_int8.engine failed, try rebuild
0:00:27.405144384 9829 0x5594636fc490 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 1]: Trying to create engine from model files
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Reading Calibration Cache for calibrator: EntropyCalibration2
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Generated calibration scales using calibration cache. Make sure that calibration cache has latest scales.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: To regenerate calibration cache, please delete the existing one. TensorRT will generate a new calibration cache.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
INFO: …/nvdsinfer/nvdsinfer_func_utils.cpp:39 [TRT]: Detected 1 inputs and 2 output network tensors.
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1495 Serialize engine failed because of file path: /opt/nvidia/deepstream/deepstream-5.0/samples/models/Primary_Detector/resnet10.caffemodel_b4_gpu0_int8.engine opened error
0:00:32.442386732 9829 0x5594636fc490 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1743> [UID = 1]: failed to serialize cude engine to file: /opt/nvidia/deepstream/deepstream-5.0/samples/models/Primary_Detector/resnet10.caffemodel_b4_gpu0_int8.engine
WARNING: …/nvdsinfer/nvdsinfer_func_utils.cpp:36 [TRT]: Current optimization profile is: 0. Please ensure there are no enqueued operations pending in this context prior to switching profiles
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:685 [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x368x640
1 OUTPUT kFLOAT conv2d_bbox 16x23x40
2 OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40
0:00:32.447113083 9829 0x5594636fc490 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/config_infer_primary.txt sucessfully
Runtime commands:
h: Print this help
q: Quit
p: Pause
r: Resume
NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
To go back to the tiled display, right-click anywhere on the window.
**PERF: FPS 0 (Avg) FPS 1 (Avg) FPS 2 (Avg) FPS 3 (Avg)
**PERF: 0.00 (0.00) 0.00 (0.00) 0.00 (0.00) 0.00 (0.00)
** INFO: <bus_callback:181>: Pipeline ready
** INFO: <bus_callback:167>: Pipeline running
Segmentation fault (core dumped)
My nvidia driver and cuda version shown below:
My nvidia driver and cuda version shown below:
A bit late with the answer.
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:1523 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app/…/…/models/Primary_Detector/resnet10.caffemodel_b4_gpu0_int8.engine open error
The error message already give you the clue that is pointing to an engine file that does not exist on the path. Probably provide the full path to the engine file in the config file.
I've created a kettle transformation and i've tested on my pc and it works. However, i've insered it in the server and starting as bash script by pan.sh. It was working but after few times it started to give this problem.
server$ bash pan.sh file="API_Mining_LatestVersion.ktr"
#######################################################################
WARNING: no libwebkitgtk-1.0 detected, some features will be unavailable
Consider installing the package with apt-get or yum.
e.g. 'sudo apt-get install libwebkitgtk-1.0-0'
#######################################################################
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
14:56:00,682 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled
14:56:00,803 INFO [KarafInstance]
*******************************************************************************
*** Karaf Instance Number: 2 at /data/Fernando/data-integration_updated/./s ***
*** ystem/karaf/caches/pan/data-1 ***
*** FastBin Provider Port:52902 ***
*** Karaf Port:8803 ***
*** OSGI Service Port:9052 ***
*******************************************************************************
Nov 20, 2018 2:56:01 PM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
*ERROR* [org.osgi.service.cm.ManagedService, id=255, bundle=53/mvn:org.apache.aries.transaction/org.apache.aries.transaction.manager/1.1.1]: Updating configuration org.apache.aries.transaction caused a problem: null
org.osgi.service.cm.ConfigurationException: null : null
at org.apache.aries.transaction.internal.TransactionManagerService.<init>(TransactionManagerService.java:136)
at org.apache.aries.transaction.internal.Activator.updated(Activator.java:63)
at org.apache.felix.cm.impl.helper.ManagedServiceTracker.updateService(ManagedServiceTracker.java:148)
at org.apache.felix.cm.impl.helper.ManagedServiceTracker.provideConfiguration(ManagedServiceTracker.java:81)
at org.apache.felix.cm.impl.ConfigurationManager$ManagedServiceUpdate.provide(ConfigurationManager.java:1448)
at org.apache.felix.cm.impl.ConfigurationManager$ManagedServiceUpdate.run(ConfigurationManager.java:1404)
at org.apache.felix.cm.impl.UpdateThread.run(UpdateThread.java:103)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.objectweb.howl.log.LogConfigurationException: Unable to obtain lock on /data/Fernando/data-integration/system/karaf/caches/pan/data-1/txlog/transaction_1.log
at org.objectweb.howl.log.LogFile.open(LogFile.java:191)
at org.objectweb.howl.log.LogFileManager.open(LogFileManager.java:784)
at org.objectweb.howl.log.Logger.open(Logger.java:304)
at org.objectweb.howl.log.xa.XALogger.open(XALogger.java:893)
at org.apache.aries.transaction.internal.HOWLLog.doStart(HOWLLog.java:233)
at org.apache.aries.transaction.internal.TransactionManagerService.<init>(TransactionManagerService.java:133)
... 7 more
2018-11-20 14:56:04.508:INFO:oejs.Server:jetty-8.1.15.v20140411
2018-11-20 14:56:04.544:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper#0.0.0.0:9052
[...]
INFO: New Caching Service registered
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/data/Fernando/data-integration_updated/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/data/Fernando/data-integration_updated/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2018/11/20 14:56:09 - Pan - Start of run.
ERROR: No repository provided, can't load transformation.
I don't understand where the problem is. The transformation file hasn't been changed and it contains also repo, user and pass paramethers.
for example if I changed small code I will get this result in gradle console x
processing com/google/android/gms/internal/c$b.class...
processing com/google/android/gms/internal/f.class...
processing com/google/android/gms/internal/iy$1.class...
processing com/google/android/gms/internal/kj.class...
processing com/google/android/gms/internal/qn.class...
processing com/google/android/gms/internal/jl$a.class...
processing com/google/android/gms/internal/qo.class...
processing com/google/android/gms/internal/os.class...
processing com/google/android/gms/internal/c$d.class...
processing com/google/android/gms/internal/qw.class...
processing com/google/android/gms/internal/ke$1.class...
processing com/google/android/gms/internal/qt.class...
processing com/google/android/gms/internal/jt$a$a.class...
processing com/google/android/gms/internal/jv$1.class...
processing com/google/android/gms/internal/ju$a.class...
processing com/google/android/gms/internal/li.class...
processing com/google/android/gms/internal/ih$a$a.class...
processing com/google/android/gms/internal/jq.class...
processing com/google/android/gms/internal/jl$c.class...
processing com/google/android/gms/internal/op.class...
processing com/google/android/gms/internal/r$a$a.class...
processing com/google/android/gms/internal/ke$a.class...
processing com/google/android/gms/internal/jp.class...
processing com/google/android/gms/internal/f$h.class...
processing com/google/android/gms/internal/js.class...
processing com/google/android/gms/internal/qp.class...
processing com/google/android/gms/internal/j.class...
processing com/google/android/gms/internal/kv$b.class...
processing com/google/android/gms/internal/oq$a$a.class...
processing com/google/android/gms/internal/oq.class...
processing com/google/android/gms/internal/o.class...
processing com/google/android/gms/internal/ox.class...
processing com/google/android/gms/internal/iy$2.class...
processing com/google/android/gms/internal/kg.class...
processing com/google/android/gms/internal/r.class...
processing com/google/android/gms/internal/f$i.class...
processing com/google/android/gms/internal/kr.class...
processing com/google/android/gms/internal/jo.class...
processing com/google/android/gms/internal/jc.class...
processing com/google/android/gms/internal/la.class...
processing com/google/android/gms/internal/jl$f.class...
processing com/google/android/gms/internal/ra$d.class...
processing com/google/android/gms/internal/i$a.class...
processing com/google/android/gms/internal/ig.class...
processing com/google/android/gms/internal/p.class...
processing com/google/android/gms/internal/lj.class...
processing com/google/android/gms/internal/f$d.class...
processing com/google/android/gms/internal/jr$a.class...
processing com/google/android/gms/internal/kw.class...
processing com/google/android/gms/internal/jm.class...
processing com/google/android/gms/internal/jb.class...
processing com/google/android/gms/internal/kf$a.class...
processing com/google/android/gms/internal/qu.class...
processing com/google/android/gms/internal/ld.class...
processing com/google/android/gms/internal/kq.class...
processing com/google/android/gms/internal/jr.class...
processing com/google/android/gms/internal/iz$1.class...
processing com/google/android/gms/internal/kc.class...
processing com/google/android/gms/internal/ko.class...
processing com/google/android/gms/internal/kh.class...
processing com/google/android/gms/internal/kn.class...
processing com/google/android/gms/internal/ji.class...
processing com/google/android/gms/internal/qq.class...
processing com/google/android/gms/internal/s$a$a.class...
processing com/google/android/gms/internal/c$f.class...
processing com/google/android/gms/internal/kb.class...
processing com/google/android/gms/internal/jn$a.class...
processing com/google/android/gms/internal/c$i.class...
processing com/google/android/gms/internal/lf.class...
processing com/google/android/gms/internal/n.class...
processing com/google/android/gms/internal/qs.class...
processing com/google/android/gms/internal/iy$3.class...
processing com/google/android/gms/internal/jl$h.class...
processing com/google/android/gms/internal/jj.class...
processing com/google/android/gms/internal/qy.class...
processing com/google/android/gms/internal/ra$c.class...
processing com/google/android/gms/internal/lh.class...
processing com/google/android/gms/internal/jn.class...
processing com/google/android/gms/internal/ke.class...
processing com/google/android/gms/internal/ju.class...
processing com/google/android/gms/internal/jm$a.class...
processing com/google/android/gms/internal/oq$a.class...
processing com/google/android/gms/internal/ko$a.class...
processing com/google/android/gms/internal/j$1.class...
processing com/google/android/gms/internal/f$c.class...
processing com/google/android/gms/internal/jq$a.class...
processing com/google/android/gms/internal/kh$a$a.class...
processing com/google/android/gms/internal/c$c.class...
processing com/google/android/gms/internal/iz.class...
processing com/google/android/gms/internal/c$j.class...
processing com/google/android/gms/internal/lm.class...
processing com/google/android/gms/internal/q.class...
processing com/google/android/gms/internal/lb.class...
processing com/google/android/gms/internal/f$k.class...
processing com/google/android/gms/internal/kv.class...
processing com/google/android/gms/internal/js$a$a.class...
processing com/google/android/gms/internal/f$a.class...
processing com/google/android/gms/internal/kh$a.class...
processing com/google/android/gms/internal/jn$a$a.class...
processing com/google/android/gms/internal/jl$e.class...
processing com/google/android/gms/internal/g.class...
processing com/google/android/gms/internal/iz$b.class...
processing com/google/android/gms/internal/ra$b.class...
processing com/google/android/gms/internal/f$g.class...
processing com/google/android/gms/internal/os$a.class...
processing com/google/android/gms/internal/jm$b.class...
processing com/google/android/gms/internal/qv.class...
processing com/google/android/gms/internal/f$e.class...
processing com/google/android/gms/internal/kl.class...
processing com/google/android/gms/internal/qz.class...
processing com/google/android/gms/internal/kc$1.class...
processing com/google/android/gms/internal/jt$a.class...
processing com/google/android/gms/internal/f$1.class...
processing com/google/android/gms/internal/d$a.class...
processing com/google/android/gms/internal/jh.class...
processing com/google/android/gms/internal/je.class...
processing com/google/android/gms/internal/kv$a.class...
processing com/google/android/gms/internal/f$b.class...
processing com/google/android/gms/internal/b.class...
processing com/google/android/gms/internal/ra.class...
processing com/google/android/gms/internal/iy$b.class...
processing com/google/android/gms/internal/kk.class...
processing com/google/android/gms/internal/ky.class...
processing com/google/android/gms/internal/pu$a.class...
processing com/google/android/gms/internal/ra$a.class...
processing com/google/android/gms/internal/iy$a.class...
processing com/google/android/gms/internal/lg.class...
processing com/google/android/gms/internal/m.class...
processing com/google/android/gms/internal/kr$b.class...
processing com/google/android/gms/internal/c$a.class...
processing com/google/android/gms/internal/qr.class...
processing com/google/android/gms/internal/hb.class...
processing com/google/android/gms/internal/jd.class...
processing com/google/android/gms/internal/iz$a$a.class...
processing com/google/android/gms/internal/ki.class...
processing com/google/android/gms/internal/oo.class...
processing com/google/android/gms/internal/kx.class...
processing com/google/android/gms/internal/c$h.class...
processing com/google/android/gms/internal/l.class...
processing com/google/android/gms/internal/jz.class...
processing com/google/android/gms/internal/pu.class...
processing com/google/android/gms/internal/f$j.class...
processing com/google/android/gms/internal/kp.class...
processing com/google/android/gms/internal/r$a.class...
processing com/google/android/gms/internal/ka.class...
processing com/google/android/gms/internal/ks.class...
processing com/google/android/gms/internal/s$a.class...
processing com/google/android/gms/internal/h.class...
processing com/google/android/gms/internal/i.class...
processing com/google/android/gms/internal/ki$a.class...
processing com/google/android/gms/internal/kz.class...
processing com/google/android/gms/internal/f$l.class...
processing com/google/android/gms/internal/jl$d.class...
processing com/google/android/gms/internal/jv.class...
processing com/google/android/gms/internal/kf.class...
processing com/google/android/gms/internal/f$f.class...
processing com/google/android/gms/internal/c.class...
processing com/google/android/gms/internal/jb$a.class...
processing com/google/android/gms/internal/kt.class...
processing com/google/android/gms/internal/s.class...
processing com/google/android/gms/internal/lc.class...
processing com/google/android/gms/internal/km.class...
processing com/google/android/gms/internal/kd.class...
processing com/google/android/gms/internal/jf.class...
processing com/google/android/gms/internal/kr$a.class...
processing com/google/android/gms/internal/lk.class...
processing com/google/android/gms/internal/qp$a.class...
processing com/google/android/gms/internal/ju$a$a.class...
processing com/google/android/gms/internal/o$a.class...
processing com/google/android/gms/internal/jc$a.class...
processing com/google/android/gms/internal/c$e.class...
processing com/google/android/gms/internal/iy.class...
processing com/google/android/gms/ads/identifier/AdvertisingIdClient.class...
processing com/google/android/gms/ads/identifier/AdvertisingIdClient$Info.class...
processing com/google/android/gms/ads/identifier/AdvertisingIdClient$a.class...
processing com/google/android/gms/dynamic/a.class...
processing com/google/android/gms/dynamic/d.class...
processing com/google/android/gms/dynamic/e.class...
processing com/google/android/gms/dynamic/f.class...
processing com/google/android/gms/dynamic/a$3.class...
processing com/google/android/gms/dynamic/a$5.class...
processing com/google/android/gms/dynamic/a$4.class...
processing com/google/android/gms/dynamic/LifecycleDelegate.class...
processing com/google/android/gms/dynamic/a$7.class...
processing com/google/android/gms/dynamic/a$a.class...
processing com/google/android/gms/dynamic/c$a$a.class...
processing com/google/android/gms/dynamic/a$1.class...
processing com/google/android/gms/dynamic/g.class...
processing com/google/android/gms/dynamic/a$6.class...
processing com/google/android/gms/dynamic/d$a$a.class...
processing com/google/android/gms/dynamic/d$a.class...
processing com/google/android/gms/dynamic/b.class...
processing com/google/android/gms/dynamic/c$a.class...
processing com/google/android/gms/dynamic/g$a.class...
processing com/google/android/gms/dynamic/h.class...
processing com/google/android/gms/dynamic/a$2.class...
processing com/google/android/gms/dynamic/c.class...
processing com/google/android/gms/gcm/GoogleCloudMessaging$1.class...
processing com/google/android/gms/gcm/GoogleCloudMessaging.class...
processing com/google/android/gms/analytics/ExceptionParser.class...
processing com/google/android/gms/analytics/k.class...
processing com/google/android/gms/analytics/Tracker.class...
processing com/google/android/gms/analytics/ad.class...
processing com/google/android/gms/analytics/w$b.class...
processing com/google/android/gms/analytics/w$2.class...
processing com/google/android/gms/analytics/ac.class...
processing com/google/android/gms/analytics/h$1.class...
processing com/google/android/gms/analytics/CampaignTrackingReceiver.class...
processing com/google/android/gms/analytics/w$1.class...
processing com/google/android/gms/analytics/a.class...
processing com/google/android/gms/analytics/StandardExceptionParser.class...
processing com/google/android/gms/analytics/HitBuilders.class...
processing com/google/android/gms/analytics/d.class...
processing com/google/android/gms/analytics/e.class...
processing com/google/android/gms/analytics/w$a.class...
processing com/google/android/gms/analytics/Logger.class...
processing com/google/android/gms/analytics/HitBuilders$HitBuilder.class...
processing com/google/android/gms/analytics/c$b.class...
processing com/google/android/gms/analytics/f.class...
processing com/google/android/gms/analytics/aa.class...
processing com/google/android/gms/analytics/HitBuilders$ExceptionBuilder.class...
processing com/google/android/gms/analytics/n$a.class...
processing com/google/android/gms/analytics/z$a.class...
processing com/google/android/gms/analytics/GoogleAnalytics$a.class...
processing com/google/android/gms/analytics/HitBuilders$SocialBuilder.class...
processing com/google/android/gms/analytics/j.class...
processing com/google/android/gms/analytics/GoogleAnalytics$b.class...
processing com/google/android/gms/analytics/w$d.class...
processing com/google/android/gms/analytics/y.class...
processing com/google/android/gms/analytics/o.class...
processing com/google/android/gms/analytics/HitBuilders$EventBuilder.class...
processing com/google/android/gms/analytics/v$1.class...
processing com/google/android/gms/analytics/r.class...
processing com/google/android/gms/analytics/ai.class...
processing com/google/android/gms/analytics/y$a.class...
processing com/google/android/gms/analytics/x$1.class...
processing com/google/android/gms/analytics/p.class...
processing com/google/android/gms/analytics/Logger$LogLevel.class...
processing com/google/android/gms/analytics/ExceptionReporter.class...
processing com/google/android/gms/analytics/Tracker$a.class...
processing com/google/android/gms/analytics/x$d.class...
processing com/google/android/gms/analytics/TrackerHandler.class...
processing com/google/android/gms/analytics/al.class...
processing com/google/android/gms/analytics/n.class...
processing com/google/android/gms/analytics/z.class...
processing com/google/android/gms/analytics/u.class...
processing com/google/android/gms/analytics/k$1.class...
processing com/google/android/gms/analytics/w.class...
processing com/google/android/gms/analytics/c$c.class...
processing com/google/android/gms/analytics/q.class...
processing com/google/android/gms/analytics/t.class...
processing com/google/android/gms/analytics/CampaignTrackingService.class...
processing com/google/android/gms/analytics/ag$a.class...
processing com/google/android/gms/analytics/ak.class...
processing com/google/android/gms/analytics/x$c.class...
processing com/google/android/gms/analytics/g.class...
processing com/google/android/gms/analytics/v$2.class...
processing com/google/android/gms/analytics/x$b.class...
processing com/google/android/gms/analytics/HitBuilders$TimingBuilder.class...
processing com/google/android/gms/analytics/ab.class...
processing com/google/android/gms/analytics/af.class...
processing com/google/android/gms/analytics/aj.class...
processing com/google/android/gms/analytics/am.class...
processing com/google/android/gms/analytics/b.class...
processing com/google/android/gms/analytics/x$a.class...
processing com/google/android/gms/analytics/ae.class...
processing com/google/android/gms/analytics/v.class...
processing com/google/android/gms/analytics/m.class...
processing com/google/android/gms/analytics/c$a.class...
processing com/google/android/gms/analytics/w$c.class...
processing com/google/android/gms/analytics/l.class...
processing com/google/android/gms/analytics/h.class...
processing com/google/android/gms/analytics/i.class...
processing com/google/android/gms/analytics/w$e.class...
it is normal to take
16:03:08.530 [LIFECYCLE] [org.gradle.BuildResultLogger] Total time: 3 mins 9.729 secs
These are some libraries that I use
compile 'com.android.support:multidex:1.0.0'
compile 'com.android.support:support-v4:21.+"'
/*compile project(':viewPagerIndicator241')*/
compile 'com.google.code.gson:gson:2.2.4'
compile 'com.google.android.gms:play-services-maps:6.5.87'
compile 'com.actionbarsherlock:actionbarsherlock:4.4.0#aar'
compile files('libs/achartengine-1.1.0.jar')
compile files('libs/activation.jar')
compile files('libs/additionnal.jar')
/*compile files('libs/androidannotations-api-3.2.jar')*/
compile files('libs/commons-io-2.4.jar')
/* compile files('libs/commons-lang3-3.2.jar')*/
compile files('libs/jsoup-1.8.1.jar')
compile files('libs/mail.jar')
compile files('libs/mpandroidchartlibrary-1-7-4.jar')
compile files('libs/prettytime-3.2.5.Final.jar')
Try this new build.gradle:
I would highly recommend trying to move away from MultiDex as it is very slow.
repositories {
maven { url "https://jitpack.io" }
}
android {
...
dependencies {
// Gradle dependencies
compile 'com.android.support:multidex:1.0.1' // <-- was 1.0.1
compile 'com.android.support:support-v4:22.0.0' // <-- was 21+
compile 'com.google.code.gson:gson:2.3.1' // <-- was 2.2.4
compile 'com.google.android.gms:play-services-maps:7.0.0' // <-- was 6.5.87
compile 'com.actionbarsherlock:actionbarsherlock:4.4.0#aar' // <-- deprecated, move to AppCompat
compile 'commons-io:commons-io:2.4' // <-- was compile files('libs/commons-io-2.4.jar')
compile 'org.jsoup:jsoup:1.8.1' // <-- was compile files('libs/jsoup-1.8.1.jar')
compile 'com.github.PhilJay:MPAndroidChart:v2.0.8' // <-- was compile files('libs/mpandroidchartlibrary-1-7-4.jar')
compile 'org.ocpsoft.prettytime:prettytime-nlp:3.2.5.Final' // <-- was files('libs/prettytime-3.2.5.Final.jar')
// Jars
compile files('libs/achartengine-1.1.0.jar')
compile files('libs/mail.jar')
compile files('libs/additionnal.jar')
compile files('libs/activation.jar')
}
}
I'd suggest trying to remove some of these dependencies:
Jake Whartons's ActionBarSherlock is DEPRECATED, switch to App Compat
You have 2 chart libraries achartengine and mpandroidchartlibrary
Do you really need Google's gson vs Android's built-in json libs?
Do you really need Common's IO?
I am calling a UDF written in Java from a Pig script.
In the UDF if for some reason the input is not proper I return null and that particular row/line is skipped.
Now there are many reason for which I could have skipped the current line/row. I am current using the following log statement in my UDF
warn("XML is null, so skipping it", PigWarning.UDF_WARNING_1);
....
warn("Entity is null, so skipping it", PigWarning.UDF_WARNING_5);
.... and so on
Once the Pig script is done, this give me a consolidate info like below
2013-01-21 07:03:42,163 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Encountered Warning UDF_WARNING_5 5473 time(s).
2013-01-21 07:03:42,163 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Encountered Warning UDF_WARNING_1 1466 time(s).
But now I want to know the reason why each line failed, instead of just the numbers. Is there any way to do this in Pig?
I found out a library called penny which allowed me to do logging and filtering in Pig.