2021-08-25 01:22:30.411 26300 b2020.2.15.58 -> failed to deallocate device memory 2021-08-25 01:35:49.795 20052 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-09-05 02:26:09.006 20464 b2020.2.15.58 We can't evaluate items of a different version (version 0)! 2021-10-13 19:49:10.940 1192 b2020.2.15.58 +++++ Plugin started. 2021-10-19 00:09:54.556 21092 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:09:55.140 13012 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 00:09:55.671 28092 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:09:56.239 28092 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:09:56.833 28092 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 00:09:57.509 28092 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:09:58.074 28092 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:09:58.632 28092 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:09:59.200 28092 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:09:59.743 28092 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:10:00.323 28092 b2020.2.15.58 -> could not get memory info 2021-10-19 00:10:00.853 28092 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 00:10:01.395 28092 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:10:01.922 13012 b2020.2.15.58 -> could not get memory info 2021-10-19 00:10:02.475 13012 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 00:10:03.016 13012 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 00:34:18.047 28988 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 00:34:18.363 28988 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 00:34:18.693 27736 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:34:19.036 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:19.361 27736 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:34:19.721 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:20.018 27736 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:34:20.303 27736 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:34:20.606 29528 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:34:20.933 29528 b2020.2.15.58 -> could not get memory info 2021-10-19 00:34:21.212 27736 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:34:21.489 29528 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 00:34:21.776 27736 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:34:22.071 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:22.361 27736 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:34:22.651 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:22.936 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:23.217 29528 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 00:34:23.497 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:23.783 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:24.082 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:24.378 29528 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 00:34:24.660 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:24.938 27736 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:34:25.225 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:25.499 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:34:25.792 29528 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:15.137 26792 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:15.324 26792 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:15.505 26792 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:15.686 4932 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 00:49:15.890 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:16.085 1568 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:16.259 4932 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:16.433 1568 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:16.595 4932 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:16.757 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:16.922 1568 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 00:49:17.094 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:17.261 4932 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:17.428 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:17.592 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:17.756 4932 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:17.923 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:18.088 4932 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:18.261 4932 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:18.453 1568 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:18.618 4932 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 00:49:18.784 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:18.954 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:19.132 4932 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:19.376 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:19.545 4932 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:19.719 1568 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:19.885 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:20.052 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:20.227 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:20.410 4932 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 00:49:20.581 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:20.743 4932 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:20.917 1568 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 00:49:21.086 1568 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:21.274 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:21.481 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:21.661 1568 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:21.839 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:22.012 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:22.204 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:22.408 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:22.580 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:22.747 4932 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 00:49:22.915 4932 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:23.088 1568 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 00:49:23.283 4932 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 00:49:23.491 4932 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 00:49:23.654 1568 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:23.814 1568 b2020.2.15.58 -> could not get memory info 2021-10-19 00:49:23.977 1568 b2020.2.15.58 OptiX error for device 1: [ERROR] Failed to destroy launch resources (CUDA error string: an illegal memory access was encountered, CUDA error code: 700) 2021-10-19 00:49:24.155 1568 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 02:33:12.821 17508 b2020.2.15.58 +++++ Plugin started. 2021-10-19 12:45:09.852 27036 b2020.2.15.58 +++++ Plugin started. 2021-10-19 15:52:48.786 21412 b2020.2.15.58 Render engine failure occured! (WARNING) 2021-10-19 15:53:14.765 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:14.812 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:14.856 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:14.903 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:14.952 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.000 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.049 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.099 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.151 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.197 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.246 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.289 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.332 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.376 2284 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.423 20388 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:15.468 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:15.512 20388 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:15.550 20388 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:15.590 20388 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:15.629 6148 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:15.669 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:15.710 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.751 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:15.792 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:15.832 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:15.874 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:15.916 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:15.957 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:15.996 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:16.036 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:16.076 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:16.117 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:16.157 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:16.198 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:16.238 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:16.278 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:16.320 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:16.364 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:16.403 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:16.443 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:16.488 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:16.528 6148 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:16.568 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:16.608 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:16.646 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:16.688 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:16.731 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:16.769 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:16.809 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:16.849 6148 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:16.892 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:16.931 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:16.974 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:17.014 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:17.054 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.094 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:17.137 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:17.176 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:17.216 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:17.257 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:17.297 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:17.338 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.377 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.424 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:17.465 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:17.512 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.552 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.593 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.635 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.676 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:17.718 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:17.758 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.797 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.836 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.878 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:17.917 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:17.956 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:17.998 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.040 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.091 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.150 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:18.207 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:18.257 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:18.303 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:18.350 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:18.394 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.434 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.479 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.520 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.561 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:18.601 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.640 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.684 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:18.726 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:18.766 6148 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:18.805 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:18.845 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:18.885 6148 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:18.924 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:18.963 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.003 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.043 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.083 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:19.141 6148 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:19.184 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:19.228 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:19.274 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:19.320 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:19.360 20388 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:19.400 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:19.439 20388 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:19.480 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.521 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.560 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.600 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:19.639 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:19.677 6148 b2020.2.15.58 -> failed to destroy texture objects 2021-10-19 15:53:19.716 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.758 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:19.798 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.838 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:19.880 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:19.919 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:19.962 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.005 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.049 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:20.095 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.136 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:20.176 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.216 6148 b2020.2.15.58 -> failed to deallocate device array 2021-10-19 15:53:20.256 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:20.298 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:20.341 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:20.380 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.418 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.456 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.497 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.540 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:20.580 20388 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:20.619 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:20.659 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:20.700 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:20.743 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:20.783 20388 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:20.823 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:20.863 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.902 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.941 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:20.981 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:21.023 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:21.064 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:21.103 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.143 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.198 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.237 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.276 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.316 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:21.355 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.394 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.434 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:21.472 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.510 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.550 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:21.589 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:21.630 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:21.672 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:21.710 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:21.754 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:21.796 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:21.835 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:21.877 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:21.917 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:21.959 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:21.999 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.041 20388 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:22.084 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:22.125 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:22.166 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:22.207 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.247 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.287 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.344 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.382 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.420 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:22.458 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:22.498 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.536 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:22.581 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:22.619 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.660 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:22.702 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:22.741 6148 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 15:53:22.781 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:22.819 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:22.858 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:22.898 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.940 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:22.979 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:23.019 6148 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:23.062 6148 b2020.2.15.58 OptiX error for device 1: [ERROR] Error synching on OptixPipeline event (CUDA error string: an illegal memory access was encountered, CUDA error code: 700) 2021-10-19 15:53:23.095 20388 b2020.2.15.58 -> could not get memory info 2021-10-19 15:53:23.135 6148 b2020.2.15.58 CUDA error 700 on device 1: an illegal memory access was encountered 2021-10-19 15:53:23.173 6148 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:23.213 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:23.253 6148 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:23.292 20388 b2020.2.15.58 CUDA error 700 on device 0: an illegal memory access was encountered 2021-10-19 15:53:23.332 20388 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:23.374 20388 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:23.413 6148 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:23.451 6148 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:23.494 20388 b2020.2.15.58 -> failed to destroy CUDA event 2021-10-19 15:53:23.533 20388 b2020.2.15.58 -> failed to deallocate device memory 2021-10-19 17:23:39.693 2592 b2020.2.15.58 ON_dzMainWindow_aboutToClose 2021-10-20 03:43:43.582 28432 b2020.2.15.58 Unhandled exception in concurrent loop: bad allocation 2021-10-20 03:51:47.900 28432 b2020.2.15.58 Unhandled exception in concurrent loop: bad allocation 2021-10-20 03:59:33.174 18628 b2020.2.15.58 +++++ Plugin ended. 2021-10-20 04:09:16.160 5156 b2020.2.15.58 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2021-10-20 04:09:26.038 5156 b2020.2.15.58 +++++ Plugin running. 2021-10-20 12:13:46.520 5156 b2020.2.15.58 ON_dzMainWindow_aboutToClose 2021-11-05 15:13:22.031 15164 b2020.2.15.58 +++++ Plugin started. 2021-11-05 18:05:42.687 22748 b2020.2.17.61 ON_dzMainWindow_aboutToClose 2021-11-06 01:11:11.469 9164 b2020.2.17.61 +++++ Plugin ended. 2021-11-06 03:22:34.298 30876 b2020.2.17.61 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2021-11-06 03:22:42.704 30876 b2020.2.17.61 +++++ Plugin running. 2021-11-06 03:36:50.082 30876 b2020.2.17.61 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2021-11-07 23:16:18.036 30468 b2020.2.17.61 +++++ Plugin started. 2021-11-08 00:24:33.813 8392 b2020.2.17.61 +++++ Plugin started. 2021-11-11 19:38:47.522 6936 b2020.2.17.61 CUDA error 2 on device 0: out of memory 2021-11-11 19:38:47.537 944 b2020.2.17.61 Render engine failure occured! (WARNING) 2021-11-11 19:39:39.974 19352 b2020.2.17.61 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2021-11-11 19:39:48.602 19352 b2020.2.17.61 +++++ Plugin running. 2021-11-11 19:50:31.365 20664 b2020.2.17.61 device 1: path tracing kernel failed 2021-11-11 19:50:31.383 30048 b2020.2.17.61 device 0: path tracing kernel failed 2021-11-11 20:02:04.562 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.573 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.583 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.594 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.604 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.614 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.623 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.634 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.646 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.658 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.669 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.679 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.690 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.700 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.709 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.719 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.729 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.739 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.748 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.758 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.768 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.778 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.788 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.799 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.810 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.820 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.830 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.840 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.850 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.861 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.872 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.896 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.907 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.916 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.927 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.936 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.947 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.959 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.969 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.979 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.989 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:04.999 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.008 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.019 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.029 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.039 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.049 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.058 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.069 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.079 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.090 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.100 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.110 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.120 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.130 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.139 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.149 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.159 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.168 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.179 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.188 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.198 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.208 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.218 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.227 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.237 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.247 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.257 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.267 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.276 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.285 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.295 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.305 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.314 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.324 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.333 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.343 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.352 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.363 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.373 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.382 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.393 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.404 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.415 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.425 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.435 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.445 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.455 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.464 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.476 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.486 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.497 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.508 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.519 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.528 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.538 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.548 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.558 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.568 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.578 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.588 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.598 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.609 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.618 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.628 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.639 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.649 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.659 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.668 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.678 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.688 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.698 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.707 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.717 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.728 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.738 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.748 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.758 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.769 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.779 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.788 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.799 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.810 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.819 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.830 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.840 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.850 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.860 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.870 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.879 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.890 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.900 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.909 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.919 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.929 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.938 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.948 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.958 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.968 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.978 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.988 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:05.998 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.008 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.017 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.027 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.036 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.046 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.057 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.066 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.076 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.086 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.097 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.107 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.117 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.127 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.137 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.148 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.158 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.169 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.179 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.189 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.200 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.211 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.220 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.230 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.240 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.250 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.260 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.270 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.280 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.291 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.301 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.312 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.322 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.332 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.342 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.352 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.361 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.372 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.384 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.394 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.405 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.415 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.425 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.434 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.445 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.454 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.464 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.475 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.485 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.497 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.508 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.519 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.531 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.542 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.552 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.563 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.574 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.584 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.594 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.605 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.614 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.624 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.634 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.644 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.655 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.666 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.677 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.687 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.698 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.708 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.717 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.729 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.739 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.749 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.760 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.770 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.780 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.789 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.799 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.809 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.819 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.829 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.840 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.850 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.860 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.870 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.880 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.890 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.899 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.923 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.933 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.943 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.952 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.962 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.973 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.982 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:06.993 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.004 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.014 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.024 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.033 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.043 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.053 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.063 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.074 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.085 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.096 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.106 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.116 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.126 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.135 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.145 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.155 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.165 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.175 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.185 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.195 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.207 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.217 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.227 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.237 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.247 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.257 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.266 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.276 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.287 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.298 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.308 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.317 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.328 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.337 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.347 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.358 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.367 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.377 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.388 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.398 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.408 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.418 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.428 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.439 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.448 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.458 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.469 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.479 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.490 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.501 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.511 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.522 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.532 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.543 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.553 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.564 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.575 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.586 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.597 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.609 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.618 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.629 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.639 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.649 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.659 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.670 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.681 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.692 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.702 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.712 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.723 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.732 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.742 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.753 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.764 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.775 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.784 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.795 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.805 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.814 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.826 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.835 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.846 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.857 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.866 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.877 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.888 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.897 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.907 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.917 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.927 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.936 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.947 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.957 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.967 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.976 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.986 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:07.997 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.006 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.016 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.026 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.036 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.046 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.056 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.066 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.076 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.086 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.097 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.107 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.117 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.128 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.137 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.147 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.158 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.168 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.177 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.187 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.199 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.208 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.218 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.229 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.238 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.248 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.258 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.268 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.279 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.289 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.299 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.308 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.318 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.328 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.337 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.348 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.358 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.367 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.378 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.389 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.400 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.409 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.419 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.429 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.438 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.449 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.458 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.468 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.479 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.490 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.503 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.514 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.524 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.534 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.545 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.557 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.567 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.577 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.587 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.598 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.608 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.617 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.627 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.637 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.648 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.658 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.667 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.678 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.687 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.698 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.708 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.718 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.728 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.738 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.747 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.757 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.767 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.777 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.786 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.796 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.807 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.816 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.826 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.836 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.846 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.856 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.866 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.877 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.886 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.896 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.906 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.916 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.927 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.936 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.946 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.956 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.966 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.976 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.985 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:08.996 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.005 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.015 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.026 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.037 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.048 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.059 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.069 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.081 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.093 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.103 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.113 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.123 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.133 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.144 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.154 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.164 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.174 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.184 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.194 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.204 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.214 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.225 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.236 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.246 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.256 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.266 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.275 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.285 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.295 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.305 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.315 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.325 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.334 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.344 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.354 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.364 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.374 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.384 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.394 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.404 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.414 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.424 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.434 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.444 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.454 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.464 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.474 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.485 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.496 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.508 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.519 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.530 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.541 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.552 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.562 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.571 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.582 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.592 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.601 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.611 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.623 30048 b2020.2.17.61 OptiX error for device 0: [ERROR] Error synching on OptixPipeline event (CUDA error string: unspecified launch failure, CUDA error code: 719) 2021-11-11 20:02:09.631 30048 b2020.2.17.61 -> failed to deallocate device memory Error destroying OptixPipeline event (CUDA error string: unspecified launch failure, CUDA error code: 719) 2021-11-11 20:02:09.651 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.658 30048 b2020.2.17.61 OptiX API error for device 0: CUDA error 2021-11-11 20:02:09.669 30048 b2020.2.17.61 -> could not get memory info 2021-11-11 20:02:09.678 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.688 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.699 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.709 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.719 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.729 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.739 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.749 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.759 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.771 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.782 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.793 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.803 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.814 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.824 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.833 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.844 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.853 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.863 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:09.874 30048 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:10.444 29536 b2020.2.17.61 CUDA error 719 on device 0: unspecified launch failure 2021-11-11 20:02:10.455 20664 b2020.2.17.61 -> failed to destroy CUDA event 2021-11-11 20:02:10.466 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.477 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.486 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.497 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.507 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.517 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.528 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.539 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.549 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.559 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.568 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.579 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.590 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.601 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.611 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.621 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.631 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.641 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.651 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.661 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.671 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.682 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.693 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.704 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.716 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.726 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.737 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.746 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.756 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.767 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.777 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.788 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.800 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.811 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.821 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.832 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.841 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.852 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.861 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.871 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.882 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.891 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.902 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.911 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.921 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.930 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.941 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.950 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.960 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.971 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.981 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:10.991 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.002 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.011 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.021 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.031 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.042 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.051 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.061 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.070 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.080 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.090 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.100 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.110 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.119 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.130 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.140 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.150 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.160 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.169 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.179 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.189 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.199 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.209 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.219 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.230 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.241 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.251 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.260 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.269 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.279 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.289 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.299 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.309 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.318 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.329 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.338 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.348 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.357 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.366 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.376 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.386 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.398 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.410 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.422 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.436 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.448 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.457 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.467 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.477 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.487 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.497 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.507 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.519 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.529 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.539 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.550 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.562 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.573 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.583 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.593 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.603 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.613 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.623 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.632 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.642 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.652 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.662 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.672 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.682 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.692 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.702 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.711 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.722 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.732 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.742 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.751 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.762 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.772 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.781 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.791 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.801 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.810 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.819 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.829 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.858 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.868 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.878 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.888 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.898 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.909 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.919 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.929 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.938 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.948 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.957 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.967 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.977 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.987 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:11.998 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.008 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.018 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.027 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.037 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.047 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.057 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.067 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.078 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.088 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.098 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.108 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.118 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.128 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.137 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.147 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.156 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.167 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.176 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.186 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.196 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.206 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.215 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.225 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.234 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.245 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.255 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.265 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.274 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.285 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.295 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.305 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.314 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.324 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.334 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.343 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.353 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.363 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.372 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.382 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.392 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.403 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.413 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.422 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.431 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.441 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.451 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.460 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.470 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.480 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.489 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.498 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.508 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.517 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.528 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.537 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.546 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.555 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.566 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.577 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.587 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.597 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.607 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.616 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.626 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.635 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.646 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.656 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.665 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.676 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.686 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.696 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.706 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.716 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.725 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.735 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.745 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.755 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.764 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.775 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.784 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.795 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.805 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.815 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.824 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.834 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.845 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.854 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.864 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.873 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.883 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.894 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.904 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.914 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.923 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.932 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.942 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.951 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.961 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.970 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.980 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.989 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:12.999 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.008 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.017 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.027 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.036 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.046 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.055 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.064 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.073 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.083 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.093 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.103 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.112 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.121 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.131 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.141 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.150 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.160 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.169 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.179 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.189 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.198 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.208 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.218 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.227 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.238 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.248 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.257 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.266 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.276 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.285 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.295 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.304 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.313 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.322 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.332 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.342 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.352 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.362 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.372 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.382 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.392 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.402 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.412 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.422 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.432 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.441 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.451 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.461 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.470 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.481 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.490 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.501 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.511 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.520 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.532 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.542 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.552 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.563 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.573 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.583 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.593 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.603 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.613 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.623 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.632 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.642 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.652 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.662 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.672 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.683 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.693 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.703 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.713 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.722 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.732 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.741 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.751 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.761 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.771 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.782 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.793 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.803 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.813 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.823 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.833 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.843 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.852 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.862 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.872 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.883 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.893 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.903 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.912 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.923 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.934 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.945 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.954 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.965 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.974 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.984 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:13.994 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.003 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.013 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.022 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.031 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.042 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.052 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.061 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.071 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.080 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.090 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.100 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.110 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.120 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.131 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.140 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.150 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.162 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.171 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.181 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.190 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.201 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.210 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.220 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.230 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.240 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.249 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.259 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.269 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.279 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.288 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.297 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.307 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.316 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.326 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.336 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.346 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.355 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.366 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.377 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.387 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.397 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.407 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.417 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.426 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.436 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.446 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.456 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.466 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.476 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.487 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.500 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.510 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.520 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.530 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.544 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.553 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.563 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.572 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.585 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.598 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.608 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.618 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.627 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.636 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.647 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.656 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.666 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.676 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.685 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.697 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.706 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.716 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.726 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.736 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.746 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.756 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.767 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.776 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.786 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.796 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.808 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.819 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.830 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.840 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.850 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.860 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.870 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.881 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.891 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.901 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.910 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.919 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.929 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.938 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.948 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.958 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.969 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.978 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.987 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:14.998 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.007 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.018 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.029 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.038 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.049 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.060 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.070 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.080 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.091 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.101 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.112 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.120 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.129 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.139 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.149 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.158 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.168 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.178 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.188 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.198 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.208 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.218 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.227 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.239 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.250 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.260 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.271 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.280 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.290 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.300 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.309 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.316 20664 b2020.2.17.61 OptiX API error for device 1: CUDA error 2021-11-11 20:02:15.327 20664 b2020.2.17.61 -> could not get memory info 2021-11-11 20:02:15.334 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.344 20664 b2020.2.17.61 OptiX error for device 1: [ERROR] Error synching on OptixPipeline event (CUDA error string: unspecified launch failure, CUDA error code: 719) 2021-11-11 20:02:15.351 20664 b2020.2.17.61 -> failed to deallocate device memory Error de-initializing device (CUDA error string: unspecified launch failure, CUDA error code: 719) 2021-11-11 20:02:15.375 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.385 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.396 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.406 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.417 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.426 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.436 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.445 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.457 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.468 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.479 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.488 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.499 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.508 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.518 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.528 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.538 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.549 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.560 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:02:15.570 20664 b2020.2.17.61 CUDA error 719 on device 1: unspecified launch failure 2021-11-11 20:03:14.722 21828 b2020.2.17.61 +++++ Plugin running. 2021-11-11 20:14:05.987 1312 b2020.2.17.61 CUDA error 700 on device 0: an illegal memory access was encountered 2021-11-11 20:14:05.993 1312 b2020.2.17.61 device 0: path tracing kernel failed 2021-11-11 20:14:05.999 5720 b2020.2.17.61 -> failed to copy memory from device. 2021-11-11 20:14:06.307 21828 b2020.2.17.61 Render engine failure occured! (WARNING) 2021-11-11 20:59:26.642 12304 b2020.2.17.61 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2021-11-11 20:59:36.124 12304 b2020.2.17.61 +++++ Plugin running. 2021-11-12 03:44:05.406 12304 b2020.2.17.61 ON_dzMainWindow_aboutToClose 2021-11-12 18:39:53.235 14796 b2020.2.17.61 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2021-11-12 18:39:53.239 14796 b2020.2.17.61 +++++ Plugin started. 2021-11-12 18:40:03.498 14796 b2020.2.17.61 +++++ Plugin running. 2021-11-12 19:44:47.119 27892 b2020.2.17.61 CUDA error 2 on device 1: out of memory 2021-11-12 19:44:47.124 27512 b2020.2.17.61 CUDA error 2 on device 0: out of memory 2021-11-12 19:44:47.126 27512 b2020.2.17.61 -> failed to allocate device array 2021-11-12 19:44:47.129 27892 b2020.2.17.61 -> failed to allocate device array 2021-11-12 19:44:47.134 14796 b2020.2.17.61 Render engine failure occured! (WARNING) 2021-11-12 19:44:50.135 14796 b2020.2.17.61 Render engine failure occured! (WARNING) 2021-11-12 19:44:53.231 3752 b2020.2.17.61 could not allocate enough space for primitives: bad allocation 2021-11-12 19:44:53.234 28680 b2020.2.17.61 could not allocate enough space for primitives: bad allocation 2021-11-12 19:44:56.425 28980 b2020.2.17.61 allocation error: bad allocation 2021-11-12 19:44:56.428 28980 b2020.2.17.61 failed to build acceleration structure (0) 2021-11-12 19:44:56.758 4496 b2020.2.17.61 allocation error: bad allocation 2021-11-12 19:44:56.763 4496 b2020.2.17.61 failed to build acceleration structure (0) 2021-11-12 19:44:56.924 24280 b2020.2.17.61 allocation error: bad allocation 2021-11-12 19:44:56.927 24280 b2020.2.17.61 failed to build acceleration structure (0) 2021-11-12 19:44:56.958 28612 b2020.2.17.61 Unhandled exception in concurrent loop: bad allocation 2021-11-12 19:45:11.604 3752 b2020.2.17.61 could not allocate enough space for primitives: bad allocation 2021-11-12 19:45:11.607 28612 b2020.2.17.61 Unhandled exception in concurrent loop: bad allocation 2021-11-12 19:45:22.438 14796 b2020.2.17.61 ON_dzMainWindow_aboutToClose 2021-11-12 19:45:51.065 16956 b2020.2.17.61 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2021-11-12 19:45:51.068 16956 b2020.2.17.61 +++++ Plugin started. 2021-11-12 19:45:59.956 16956 b2020.2.17.61 +++++ Plugin running. 2021-11-12 19:46:42.853 1048 b2020.2.17.61 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2021-11-12 19:46:42.857 1048 b2020.2.17.61 +++++ Plugin started. 2021-11-12 19:46:51.439 1048 b2020.2.17.61 +++++ Plugin running.