Skip to content
Snippets Groups Projects
singularity_1617572.out 2.32 MiB
Newer Older
Raymond Chia's avatar
Raymond Chia committed
2023-11-24 12:22:38.158330: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
Using TensorFlow backend
Namespace(data_input='imu', feature_method='None', lbl_str='pss', model='cnn1d', overwrite=0, subject=2, test_standing=1, train_len=5, win_shift=0.2, win_size=12)
unable to find matching config id
Data id not set, auto assigned to:  1
imu_rr_Pilot02_id1_combi5.0-7.0-10.0-12.0-15.0
train
(35921, 10)
test
(364536, 9)
---CNN1D---
2023-11-24 12:23:48.968189: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-11-24 12:23:49.308825: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-11-24 12:23:49.309060: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
input shape:  (1440, 6)
x shape:  (120, 1440, 6)
2023-11-24 12:23:49.329258: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-11-24 12:23:49.329479: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-11-24 12:23:49.329620: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-11-24 12:23:49.807484: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-11-24 12:23:49.807704: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-11-24 12:23:49.807849: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-11-24 12:23:49.807969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1639] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 14603 MB memory:  -> device: 0, name: Quadro RTX 5000, pci bus id: 0000:0b:00.0, compute capability: 7.5

Search: Running Trial #1

Value             |Best Value So Far |Hyperparameter
5                 |5                 |n_layers
128               |128               |filter_unit0
256               |256               |filter_unit1
64                |64                |filter_unit2
64                |64                |filter_unit3
32                |32                |filter_unit4
3                 |3                 |kernel_size0
4                 |4                 |kernel_size1
2                 |2                 |kernel_size2
1                 |1                 |kernel_size3
1                 |1                 |kernel_size4
2                 |2                 |pool_size0
4                 |4                 |pool_size1
2                 |2                 |pool_size2
4                 |4                 |pool_size3
4                 |4                 |pool_size4
4                 |4                 |stride_size0
4                 |4                 |stride_size1
5                 |5                 |stride_size2
2                 |2                 |stride_size3
3                 |3                 |stride_size4
0.4               |0.4               |dropout0
0.1               |0.1               |dropout1
0.2               |0.2               |dropout2
0.2               |0.2               |dropout3
0.3               |0.3               |dropout4

2023-11-24 12:23:59.104185: I tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:432] Loaded cuDNN version 8600
2023-11-24 12:24:04.313074: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x146c025ab280 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2023-11-24 12:24:04.313107: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Quadro RTX 5000, Compute Capability 7.5
2023-11-24 12:24:04.317829: I tensorflow/compiler/mlir/tensorflow/utils/dump_mlir_util.cc:255] disabling MLIR crash reproducer, set env var `MLIR_CRASH_REPRODUCER_DIRECTORY` to enable.
2023-11-24 12:24:04.440366: I ./tensorflow/compiler/jit/device_compiler.h:186] Compiled cluster using XLA!  This line is logged at most once for the lifetime of the process.


Trial 1 Complete [00h 00m 20s]
val_loss: 14.699694633483887

Best val_loss So Far: 14.699694633483887
Total elapsed time: 00h 00m 20s

Search: Running Trial #2

Value             |Best Value So Far |Hyperparameter
1                 |5                 |n_layers
64                |128               |filter_unit0
5                 |3                 |kernel_size0
5                 |2                 |pool_size0
1                 |4                 |stride_size0
0.2               |0.4               |dropout0



Trial 2 Complete [00h 00m 02s]
val_loss: 14.913914680480957

Best val_loss So Far: 14.699694633483887
Total elapsed time: 00h 00m 22s

Search: Running Trial #3

Value             |Best Value So Far |Hyperparameter
1                 |5                 |n_layers
64                |128               |filter_unit0
2                 |3                 |kernel_size0
5                 |2                 |pool_size0
4                 |4                 |stride_size0
0.1               |0.4               |dropout0



Trial 3 Complete [00h 00m 02s]
val_loss: 14.124484062194824

Best val_loss So Far: 14.124484062194824
Total elapsed time: 00h 00m 24s

Search: Running Trial #4

Value             |Best Value So Far |Hyperparameter
1                 |1                 |n_layers
128               |64                |filter_unit0
5                 |2                 |kernel_size0
1                 |5                 |pool_size0
5                 |4                 |stride_size0
0.4               |0.1               |dropout0

WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.0021s vs `on_train_batch_end` time: 0.0027s). Check your callbacks.
Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.0021s vs `on_train_batch_end` time: 0.0027s). Check your callbacks.


Trial 4 Complete [00h 00m 02s]
val_loss: 15.624482154846191

Best val_loss So Far: 14.124484062194824
Total elapsed time: 00h 00m 26s

Search: Running Trial #5

Value             |Best Value So Far |Hyperparameter
2                 |1                 |n_layers
32                |64                |filter_unit0
32                |None              |filter_unit1
3                 |2                 |kernel_size0
2                 |None              |kernel_size1
4                 |5                 |pool_size0
4                 |None              |pool_size1
5                 |4                 |stride_size0
3                 |None              |stride_size1
0.2               |0.1               |dropout0
0                 |None              |dropout1



Trial 5 Complete [00h 00m 03s]
val_loss: 14.431441307067871

Best val_loss So Far: 14.124484062194824
Total elapsed time: 00h 00m 29s

Search: Running Trial #6

Value             |Best Value So Far |Hyperparameter
2                 |1                 |n_layers
128               |64                |filter_unit0
64                |None              |filter_unit1
2                 |2                 |kernel_size0
1                 |None              |kernel_size1
1                 |5                 |pool_size0
3                 |None              |pool_size1
3                 |4                 |stride_size0
3                 |None              |stride_size1
0.3               |0.1               |dropout0
0.2               |None              |dropout1



Trial 6 Complete [00h 00m 03s]
val_loss: 14.244423866271973

Best val_loss So Far: 14.124484062194824
Total elapsed time: 00h 00m 32s

Search: Running Trial #7

Value             |Best Value So Far |Hyperparameter
4                 |1                 |n_layers
32                |64                |filter_unit0
256               |None              |filter_unit1
128               |None              |filter_unit2
128               |None              |filter_unit3
2                 |2                 |kernel_size0
4                 |None              |kernel_size1
5                 |None              |kernel_size2
2                 |None              |kernel_size3
5                 |5                 |pool_size0
4                 |None              |pool_size1
3                 |None              |pool_size2
3                 |None              |pool_size3
5                 |4                 |stride_size0
5                 |None              |stride_size1
2                 |None              |stride_size2
2                 |None              |stride_size3
0.4               |0.1               |dropout0
0.3               |None              |dropout1
0.3               |None              |dropout2
0.2               |None              |dropout3



Trial 7 Complete [00h 00m 05s]
val_loss: 13.83497142791748

Best val_loss So Far: 13.83497142791748
Total elapsed time: 00h 00m 38s

Search: Running Trial #8

Value             |Best Value So Far |Hyperparameter
3                 |4                 |n_layers
256               |32                |filter_unit0
128               |256               |filter_unit1
128               |128               |filter_unit2
2                 |2                 |kernel_size0
3                 |4                 |kernel_size1
5                 |5                 |kernel_size2
2                 |5                 |pool_size0
Loading full blame...