Migration from TheHive 3.4.0 failed

[vxsh4d0w]

Guys,
I unsuccessfully tried to migrate the old instance of TheHive 3.4.0 to newer 4.0.3. I got for three times almost the same error here below reported:

[info] a.e.s.Slf4jLogger [|] Slf4jLogger started
[info] a.r.a.t.ArteryTcpTransport [|] Remoting started with transport [Artery tcp]; listening on address [akka://[email protected]:44851] with UID [-910467743300795022]
[info] a.c.Cluster [|] Cluster Node [akka://[email protected]:44851] - Starting up, Akka version [2.6.8] ...
[info] a.c.Cluster [|] Cluster Node [akka://[email protected]:44851] - Registered cluster JMX MBean [akka:type=Cluster]
[info] a.c.Cluster [|] Cluster Node [akka://[email protected]:44851] - Started up successfully
[info] a.c.Cluster [|] Cluster Node [akka://[email protected]:44851] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
[info] a.c.Cluster [|] Cluster Node [akka://[email protected]:44851] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
[info] Instantiate JanusDatabase using cql backend
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] Already migrated:
4 profiles
3 organisations
18 users
3 impactStatuses
5 resolutionStatuses
18 observableTypes
1 customFields
5 caseTemplates
302 caseNumbers
68 alerts
[info] [Migrate case templates]
[info] [Migrate cases and alerts] Case/Task:1/5339(1959ms) Case:1/1153(4260ms)
[info] [Migrate cases and alerts] Case/Task:10/5339(263ms) Case:2/1153(22ms) Audit:50/378381(15ms) Case/Observable:89/53442(47ms)
[info] [Migrate cases and alerts] Case/Task:20/5339(9ms) Case:5/1153(14ms) Audit:188/378381(12ms) Case/Observable:328/53442(11ms)
[info] [Migrate cases and alerts] Case/Task:20/5339 Case:5/1153 Audit:441/378381(9ms) Case/Observable:543/53442(10ms)
[info] [Migrate cases and alerts] Case/Task:40/5339(6ms) Case:9/1153(7ms) Job:11/121085(10ms) Audit:669/378381(10ms) Case/Observable:635/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:45/5339(5ms) Case:10/1153(8ms) Job:105/121085(5ms) Audit:989/378381(8ms) Case/Observable:682/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:55/5339(7ms) Case:14/1153(7ms) Job:105/121085 Audit:1210/378381(7ms) Case/Observable:859/53442(10ms)
[info] [Migrate cases and alerts] Case/Task:65/5339(5ms) Case:16/1153(7ms) Job:249/121085(4ms) Audit:1413/378381(10ms) Case/Observable:901/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:80/5339(7ms) Case:19/1153(8ms) Job:249/121085 Audit:1717/378381(11ms) Case/Observable:963/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:100/5339(65ms) Case:23/1153(10ms) Job:319/121085(4ms) Audit:1890/378381(8ms) Case/Observable:1003/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:105/5339(5ms) Case:24/1153(8ms) Job:319/121085 Audit:1992/378381(7ms) Case/Observable:1585/53442(6ms)
[info] [Migrate cases and alerts] Case/Task:105/5339 Case:24/1153 Job:319/121085 Audit:2442/378381(8ms) Case/Observable:1585/53442
[info] [Migrate cases and alerts] Case/Task:110/5339(4ms) Case:25/1153(5ms) Job:425/121085(4ms) Audit:2580/378381(7ms) Case/Observable:1896/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:110/5339 Case:25/1153 Job:1207/121085(5ms) Audit:2580/378381 Case/Observable:1896/53442
[info] [Migrate cases and alerts] Case/Task:110/5339 Case:25/1153 Job:1679/121085(4ms) Audit:2580/378381 Case/Observable:1896/53442
[error] ElasticSearch request failure: POST:/the_hive_15/_search?scroll=36000000ms
StringEntity({"version":"true","query":{"bool":{"must":[{"term":{"relations":{"value":"action"}}},{"terms":{"objectId":["AXW3FzdKperogk2YS_96","AXW3FzdKperogk2YS_99","AXW3FzdKperogk2YS_98","AXW3FzdKperogk2YS_9-","AXW3FzdKperogk2YS_97","ca2e8fcf0c2f8c0a210c0426cc0bdee3","6dd46134cbc81226d93b274d5fb5c350","fc161cabfbec17baa7edc55d02752472","5099b2e1b6c71a97f35e66a6c8e1fe3f","37111eb2135313baf276ab6aa80f916d","59b7af8f185ea1726254cf314c2e6e4e","b569c775bd52ac7c3f587f112bfb1df9","f3d6a78fb86439215d754f0a3d648276","dd0c3572c12439844141c8f08763215b","ebef8a6f08fd7ea9d48fd5e4a34e8a33","8e194a8a9a5b178674d7428c4f8ca0fd","ff06578a52dcc371dd1b3b9ed2423c45","0f7cb6bb158be53dec82ed2557ca8bec","782fc12c05f0fdf1bce7d26d8267ad68","4940c1ba65b29edffcfd7758a38d887c","60b728b24d7e2932546fe5727e45202d","887b1a27da3a9d12bd11033688a36af8","f04ec75b558cc0823eae96df1e0acdbf","cec46ac96a200899895986f34b677a94","52175a56ac3a16cbfd9cfc438ca4d490","3d8b3a9de37a0a7bc9c3228469a7604b","3aa0255fc8ae7387495d67704175b228","f2c5ef526bd71d45a65e9a1040a35d28","9a650b743734917b212b5262c13b4576","1bc379a61ac55dc1c1917a8dabf605a2","f3608858407ce68deb5da664a388a7a9","5a58d5134875256ea8e03fe57dba87d3","3ba109e9ebf16629b9dbadbb5a34a732","e6bfb4a9978dbda73232ecde77bb8544","0fa0f14f28942b7f969b64cd3fb57f68","296ac1b6862c092775837128bf69468e","adb845db242e8a24ddec25987f85dfe2","dd4a2c7a4c2c106ac203a9c65841352c","818aa52c7c0a91bc8e4f78128aec7d8e","3e3e6ccfd84de4e31eb2761185d69fa6","7eb7d11bfa5078b9c37e2912ba111b92","ae9307780328764aa9291019bc51f8d4","50ef08162f049adf249644a57d77aeca","d5f0b5b32b6dd201a0016528a2281cff","1f81e6f05a24a54cf7ab3293fc379d93","4a28498a4ebbf0dad8bca6953a2032b5","f0b0b3fad8b5c21977a9fe721ae0a040","f7c503cae49b99a1fd8d3afd71c285f0","b123ccbf6253a95e9a63049bef51a024","68284d3c067a629da0cef55bf85c2df6","40da8a406f08c077d589b626c52a6b5a","e2e291b7cd945b1ab2ddadb1dc831a93","2062f5aed38bef85606ab611320ae116","32d7e4d0eb36b9e7c711586c424daeed","aed37cf533aeb17d50051909bdf59af0","269f1196caf0ecd32cf5e04d7110774c","90f7fee6b436e27bf39edc17cd025355","d7329f48944f9f698de1451d960c35de","725f00e2080e18470560bc1c37effee1","07aa312d3e87049e21ee18d271d7a123","810959966daa920777d0a9e88bb025ff","6cb9fd88fb1346b9df41678812754cb4","d48e2809769ec2a654e47ecb16e86427","01188387770e79a61103c6a112d5bfb5","6d976cbb3d4f744b30414b031986416c","51a5fb6ee234acc87852603d786ff956","55266662e4de09c1cd2aa2adb815decb","f29cc31e43e760ea129730a94d5a5db3","b07062d640f788112d7ccd35acbf052b","69bc8aa7c34a60d700aad740bf0a7eff","226a5ff69c725349f2787eb9d783f02c","7c3af815e8b9b0f3ea953155ff427c3b","55f029a143d2b817b716bba56af84e7c","ac84aa56e542c40b84fb9a410c44026f","c0882c385e5f7fa3abd1bc77aa7f4304","72deb114f59a324ab2c18c4a39d87a09","2fbf27da00ba06cd2211de09d719dd02","3419e2802d15d4305a8b361267a5b306","3541ea03700bf685a1f71e2696671ea4","b2ad6e592b0a349b8e4aad468835944b","0b558a546770a2eab6679406719ee8f3","56dae5b838c2c874e8bbade7dca8d4ab","0134a9eb48ba122bb201f43ca75043e1","89abcbc2e448ccc9f6676b79c9867277","65cab4470e7903925a3aaa119b240c3e","5739a27f0ac59daac5a334bba3e1954a","1cf93dfe082a621b51d49cf060c8e2c7","a18c6fda42398d755e73d5e...
=> ElasticError(search_phase_execution_exception,all shards failed,None,None,None,List(ElasticError(query_shard_exception,failed to create query: {
"bool" : {
"must" : [
{
"term" : {
"relations" : {
"value" : "action",
"boost" : 1.0
}
}
},
{
"terms" : {
"objectId" : [
"AXW3FzdKperogk2YS_96",
"AXW3FzdKperogk2YS_99",
"AXW3FzdKperogk2YS_98",
"AXW3FzdKperogk2YS_9-",
"AXW3FzdKperogk2YS_97",
"ca2e8fcf0c2f8c0a210c0426cc0bdee3",
"6dd46134cbc81226d93b274d5fb5c350",
"fc161cabfbec17baa7edc55d02752472",
"5099b2e1b6c71a97f35e66a6c8e1fe3f",
"37111eb2135313baf276ab6aa80f916d",
"59b7af8f185ea1726254cf314c2e6e4e",
"b569c775bd52ac7c3f587f112bfb1df9",
"f3d6a78fb86439215d754f0a3d648276",
"dd0c3572c12439844141c8f08763215b",
"ebef8a6f08fd7ea9d48fd5e4a34e8a33",
"8e194a8a9a5b178674d7428c4f8ca0fd",
"ff06578a52dcc371dd1b3b9ed2423c45",
"0f7cb6bb158be53dec82ed2557ca8bec",
"782fc12c05f0fdf1bce7d26d8267ad68",
"4940c1ba65b29edffcfd7758a38d887c",
"60b728b24d7e2932546fe5727e45202d",
"887b1a27da3a9d12bd11033688a36af8",
"f04ec75b558cc0823eae96df1e0acdbf",
"cec46ac96a200899895986f34b677a94",
"52175a56ac3a16cbfd9cfc438ca4d490",
"3d8b3a9de37a0a7bc9c3228469a7604b",
"3aa0255fc8ae7387495d67704175b228",
"f2c5ef526bd71d45a65e9a1040a35d28",
"9a650b743734917b212b5262c13b4576",
"1bc379a61ac55dc1c1917a8dabf605a2",
"f3608858407ce68deb5da664a388a7a9",
"5a58d5134875256ea8e03fe57dba87d3",
"3ba109e9ebf16629b9dbadbb5a34a732",
"e6bfb4a9978dbda73232ecde77bb8544",
"0fa0f14f28942b7f969b64cd3fb57f68",
"296ac1b6862c092775837128bf69468e",
"adb845db242e8a24ddec25987f85dfe2",
"dd4a2c7a4c2c106ac203a9c65841352c",
"818aa52c7c0a91bc8e4f78128aec7d8e",
"3e3e6ccfd84de4e31eb2761185d69fa6",
"7eb7d11bfa5078b9c37e2912ba111b92",
"ae9307780328764aa9291019bc51f8d4",
"50ef08162f049adf249644a57d77aeca",
"d5f0b5b32b6dd201a0016528a2281cff",
"1f81e6f05a24a54cf7ab3293fc379d93",
"4a28498a4ebbf0dad8bca6953a2032b5",
"f0b0b3fad8b5c21977a9fe721ae0a040",
"f7c503cae49b99a1fd8d3afd71c285f0",
"b123ccbf6253a95e9a63049bef51a024",
"68284d3c067a629da0cef55bf85c2df6",
"40da8a406f08c077d589b626c52a6b5a",
"e2e291b7cd945b1ab2ddadb1dc831a93",
"2062f5aed38bef85606ab611320ae116",.....
warn] Search error
org.thp.scalligraph.SearchError: all shards failed
at org.thp.thehive.migration.th3.DBConfiguration.$anonfun$execute$2(DBConfiguration.scala:146)
at scala.concurrent.Future.$anonfun$flatMap$1(Future.scala:307)
at scala.concurrent.impl.Promise.$anonfun$transformWith$1(Promise.scala:41)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
at org.thp.scalligraph.ContextPropagatingDisptacher$$anon$1.$anonfun$execute$2(ContextPropagatingDisptacher.scala:56)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at org.thp.scalligraph.DiagnosticContext$.$anonfun$withDiagnosticContext$2(ContextPropagatingDisptacher.scala:91)
at org.thp.scalligraph.DiagnosticContext$.saveDiagnosticContext(ContextPropagatingDisptacher.scala:106)
at org.thp.scalligraph.DiagnosticContext$.withDiagnosticContext(ContextPropagatingDisptacher.scala:89)
at org.thp.scalligraph.DiagnosticContext$$anon$2.withContext(ContextPropagatingDisptacher.scala:74)
[error] Migration failed
org.thp.scalligraph.SearchError: all shards failed
at org.thp.thehive.migration.th3.DBConfiguration.$anonfun$execute$2(DBConfiguration.scala:146)
at scala.concurrent.Future.$anonfun$flatMap$1(Future.scala:307)
at scala.concurrent.impl.Promise.$anonfun$transformWith$1(Promise.scala:41)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
at org.thp.scalligraph.ContextPropagatingDisptacher$$anon$1.$anonfun$execute$2(ContextPropagatingDisptacher.scala:56)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at org.thp.scalligraph.DiagnosticContext$.$anonfun$withDiagnosticContext$2(ContextPropagatingDisptacher.scala:91)
at org.thp.scalligraph.DiagnosticContext$.saveDiagnosticContext(ContextPropagatingDisptacher.scala:106)
at org.thp.scalligraph.DiagnosticContext$.withDiagnosticContext(ContextPropagatingDisptacher.scala:89)
at org.thp.scalligraph.DiagnosticContext$$anon$2.withContext(ContextPropagatingDisptacher.scala:74)

This error occurred several times but in different moments. Last attempts before this one the migration succeeded to move 300 case. This one just 23.
At the moment we don't have a clear idea of the root cause.