Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docker container image to run slackdump #206

Open
akostadinov opened this issue Apr 10, 2023 · 9 comments
Open

docker container image to run slackdump #206

akostadinov opened this issue Apr 10, 2023 · 9 comments
Labels
enhancement New feature or request
Milestone

Comments

@akostadinov
Copy link

akostadinov commented Apr 10, 2023

Is your feature request related to a problem? Please describe.
Hi, would be easier to have a container to run instead of relying on installing things on host machine. For example I tried to run slackdump locally and I see [pid=617132][err] /home/user/.cache/ms-playwright/firefox-1319/firefox/libstdc++.so.6: version 'GLIBCXX_3.4.30' not found (required by /lib64/libicuuc.so.69)

Describe the solution you'd like
Add docker image to release matrics. Using ghcr.io or dockerhub doesn't matter.

Describe alternatives you've considered
Alternative is to figure out local machine setup which is not ideal and not always feasible.

@rusq
Copy link
Owner

rusq commented Apr 11, 2023

Hey @akostadinov , thanks for the suggestion. It is possible to make the docker container with the Slackdump, however, that would not solve the problem that you're seeing — it won't be able to show the browser window in the OS from inside the docker container easily. Probably there's a way to make it connect to the X-window system on the host running the container, but that won't work on Windows or macOS that don't have X-windows installed. I'll see what I can do about this error, I don't remember if master branch has the ability to choose the browser, but that would have helped.

The workaround meanwhile would be the same as with containers - get the credentials (token/cookie) manually.

@rusq
Copy link
Owner

rusq commented Apr 11, 2023

Hey @akostadinov , i propagated the browser selection to the cli, you can try and use the flag -browser chromium (allowed values: "firefox" or "chromium") to use Chromium as a login browser:

https://github.com/rusq/slackdump/releases/tag/v2.3.2

@rusq rusq added bug Something isn't working help wanted Extra attention is needed labels Apr 11, 2023
@rusq
Copy link
Owner

rusq commented Apr 11, 2023

Also, if anyone else is experiencing this issue, please let me know.

For the record, what type and version of Linux are you using, @akostadinov?

@akostadinov
Copy link
Author

Thank you! I'll give it a try and report if I see issues. I'm on Fedora 36

@akostadinov
Copy link
Author

Just FYI the -browser chromium worked. Unfortunately I couldn't login to slack in this way. I think it is not an issue with slackdump but something to do with our slack instance and SSO integration.

So I had to use the manual credentials which appears to work, at least it shows log messages that threads are downloaded. I see errors like this though:

2023/04/11 14:26:15 error saving "F06DJ8P72J0-System workflow proposal" to "daily-system/attachments": callback error: download to "daily-system/attachments/F06DJ8P72J0-System workflow proposal" failed, [src=]: received empty download URL

@akostadinov
Copy link
Author

Thanks a lot for the great program!

Things seem to work. The empty attachments I think are google docs attachments that are not real attachments. So maybe it is worth making slackdump handle them more gracefully.

Just want to point out that goreleaser should be able to generate docker images. And it will be immediately useful if manual login approach is used in combination with docker run --env-file or podman run --env-file.

For getting the exports, either use docker cp or run the container with an attached volume.

While it will not allow auto-login with a browser, it will still help people that don't want to run downloaded executables or don't want to pollute their home dirs with stuff like the playwright downloads.

@rusq
Copy link
Owner

rusq commented Apr 12, 2023

Thanks for checking and your suggestions on goreleaser deployment — I'll have a look at that.

Regarding the file attachment, this error can also happen if you're running on a free Slack Workspace and the file attachment is older than 90 days and and slack hides it, but as you're saying that it's a google docs, it's interesting because I have never encountered this with google docs.

Would you be able to lookup the file "mode" value in the "files" object for it? You can locate it in the dump JSON file by searching for "F06DJ8P72J0". I guessing it would be of a "tombstone" type?

Or, if you feel comfortable attaching the "files" object entirely, (you can remove the download URLs, filename and all identifiable fields, I'll be looking at the system fields only), I'd greatly appreciate that.

This is my public GPG key that you could use to encrypt it and then just post it here:

-----BEGIN PGP PUBLIC KEY BLOCK-----

mQINBF53EqUBEADlNt/tY3xiywb0/YekE+MVKeF6XnF7F1/vwCPEW/CLGTSQ0kmA
WCP4keJYBR1yctDy+Tywg0sYLzHvvv2WwY8IaIlAqGudEMkELTw/cIkjH3kbP79W
yS2bDJ9RvFGy7DE06m5x+Cqc2hPTeAqxe/lyzs0HTPX6ZrxVBIF1EIA5EMGRT+v5
CeFYdH2uZASRR8BaDdofXENbRbqnpu0kIix3H2UcXcI3xp4G+nYyi6dvin5YzBjx
d94dcXicWo3biyZOpNw2aJHmfA6aZAUGf+kjyKWPqGnB7GrKZ0jMiByBvUg3a1NC
P/qd+p2prgoI6d6SNlazIuYIVieLRDJKhwTIl8e1TjYto0S4MjVxglLnGiQ7LMUS
zoUCHVoFBKvW+i1QcSMnp04NBzsQzdxOQeVuGIV9gNq32F41PVAf72AoVJ3ky1Xx
nyGxnZtx2tL60WIred5lF51WwPoZsek2BraGhbOqazk8O9rhhZGJ4HJgfnL1DnlI
3wie7RXyCOAMpPlFaVew3ymx+sfwP8NSkL5PR1JcuG6yZk6D+8XkwnVVTjvoi0Yg
hJHm0N2glypikHZ4hlQrzAsM/CP0/RxRqpI0TIrvSOPGwX4JbBWdfChYPB476kfp
3Bm2m6I/MJhrK4nYb7m8vEETPBTTiXSmnYWuXHM+SYN2zUtMySaZr3dMzQARAQAB
tDhSdXN0YW0gR2lseWF6b3YgPDE2MDY0NDE0K3J1c3FAdXNlcnMubm9yZXBseS5n
aXRodWIuY29tPokCVAQTAQgAPhYhBDN1MN2If7RUxPxufyO529f65U/NBQJedxKl
AhsDBQkHhh+ABQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAAAoJECO529f65U/NXx4Q
AJAkaeHhq8XjnLQzTvn4aBWGaH+OH04H6q2ibQsLpC1KalZQr+YEIX/XxuUlzDcU
n5sURXpX+ZYDG7PMlAs+fzykZI8ZaBe7B8fZmuvb0GL6ltHAkXIlAxwvZlLBLJso
iiJ1WDI2suH6AQ4yRjDP3KJ36rbxm3F71jhKyqluzYHw+vAMuM8ogGyLXaHcqviG
trAxtkvNsfpo28NGBAKhtr98wRtgd+p2WxFv6/VhKtqXeoNSrC9KBlfzqZwEYzK+
K6eZaDv9omZEXLXSENbGZmCYYGMWL7UL54sKf/yBpzDBtK0MbZYhbIYjMsDr7x5L
ORa3xhddVWEjxGZ272Q3nNJQOKLnPVlGl6VQCcqT+2e18sx7u58oZ7nHxkkXQ7ry
aIn9h55utKwjd5wuwtJAwkJQSRA7j2gTN5ju5qX5sxIT8MgK6rfK3GJRKTxcS0yL
ZwjhlC5O5WVZoOIQ+eDI7BILcPTXIfhv5g/LvCtS5CDy4bAW6hgM1yvdDv6w6oh1
lh4YjAkRFJPcazfBLt+nvY3a7SshoPe3//dn+dY8Ps+gIR9gtx65MN6loCVXzFDb
GYitGZFJVprGo3XeH62aqvG1nphTGSYHVlySnlhxCOJllnSgu8ALVFrMbBmkU958
4f+Ekkvh+EgfGRSxfC+T6IkDuVSN97Bfvv9M0hVkUY/QuQINBF53EqUBEACgC6KL
dmz5JRPvhuZ4NAPHrkwfXzikNr44YpZ225GgCZiALH463NuqFsduPklnf4Hfc1nf
aeNhakf/A7hNkJaKYVvgk2GE4St85zA1+S7zG1bTZKQKnxPWUOejrTS2EiwrEv/O
rEUiCdGNsom1VWTrcr2ogox3t8uovG3SEPQaM8I5Zzk42nw+ClDCEFBndgWSQ1I/
08WKlmDn6AVQfNtFgFCYW8kqXVxzElv7/2RdDTr5ZJ37Wvrfuzam07mYm3EX0Zcf
vu5zJhGNf7vt3ShvxhEiolqk+z72/F+BqG44K9xAOLdAokD2WEqUOyZk6ZnB7/Oy
AiDezpxpR7dxPJ21DHdm/8BNA3Qb0oIucVRukadcmu0r/R/Ejx1RrppiCBR2OYQU
AHz8VI0pmAyYhP4Es/LRgu5PDPgIQ5nl1rPKrLM4mTmFO4UjhSIA2BJ9rusdhv0l
tqE1+OaEiwInN8nAXH/LwQgfwlUYqazPQOvghLTz5BUBBHXRbDDW7pOjl7ew1joo
E1DZZ17vGKvGzNA/q1owZ+qh5wFYYmdUqX7ictz42yYPxsKOBgkZET7bWcsDSDGJ
oYSutL1cpYDm3qJZ4rnLojU8GviKmSt1Jps4CZhfsRyNeake2Eck8kMIh4q5pQah
NYEBfBeZHcw362aUYtJZGGGhkwd4/JsXiTD45wARAQABiQI8BBgBCAAmFiEEM3Uw
3Yh/tFTE/G5/I7nb1/rlT80FAl53EqUCGwwFCQeGH4AACgkQI7nb1/rlT81hTBAA
w7zdzjlCRYBNuxZPFPuBaT8dEbCLw1MjIihXXVRX2SADxh+UlzhFYJ8dXlH55O/K
xN+vXVG5lWsfBoxlPl8MlE7t1NXPHFDU17hFYRiRIM+rPP03r3fO2z+HJ6ipit31
o91j/xNw8Fxmu66/sbnrF/7kK3x7MFb1XUtsqcaBA6nOOeQ8hAnANvkG6+Kdr8iP
zPCzDELyPQI3z6umoir1oQJQBA+JL41Zav57Qasf2c28/l7aeH2shr+WRtb2Chm4
pMVXoP0U/C6Q6xBNDJFkMY8Ot0l2/2qlLe/sZbCi66YrFLNXW6WDt6sEFesv9au4
WnRxw+wHBb/n4QzvTG4apxZs48xEXciGV1ykstELoRM+nfDTNxHxiIKCTQTqM+P7
JH4sUebliip+ealnlm4iatPstweMqQtt0Flcxc7YMVzlmUayai8qCadlc/tjuOon
bDDqiCSKg0ikNV+eiMc6GXa4bZ27OOTaZ/eH63j8rACWsbxQlbjTvJdBEvdTwD/l
A9tvq05yHz7gFiEGviChMQCOIhYzP1f71kkckUi9bdmsQb1r7YBR+4954z1KMPJN
JpxVSQIjZctXVe3jgJs86GthNtv/8gG6xVpTBgoB4twnFrK/8SUf4svgmvOCImv6
NM9ENiyd7l/il9NZKtXaq8i/GDqv7RRjTy9Z5jGxhdU=
=QFMD
-----END PGP PUBLIC KEY BLOCK-----

@rusq rusq removed the help wanted Extra attention is needed label Apr 12, 2023
@akostadinov
Copy link
Author

akostadinov commented Apr 12, 2023

I tried to randomize the file id, user id and URL to begin with. Also I doubt there's anything very secret in the document. But encrypting it to err on the safe side anyway. For lurkers, the file is listed as:

"mimetype": "application/vnd.google-apps.document",
"pretty_type": "G Suite Document",
"filetype": "gdoc",
"mode": "external",

-----BEGIN PGP MESSAGE-----

hQIMA+FHKt6pGXQBAQ//ft8TnbsyUN7P0OY4dpL0qCBj2YDcC8yRE5ANeSEDgPL5
35VynMBZCQERM4IVOVp3S7Q5dHK8fqxvFsxlr9oASG3owptVL9/8jBa74CAwQX6Z
UHTQR1bDFIh0fGD0cpbCoGZh9vprx8pjRml8Fm1XTSr/oQh4dzRGYeoSxhAYHT8W
wDwa5Szc/aXOSvEA1FHBRJCVyo9eiaZwtXJqwDEyBmKF7SM3pCTPwA+5s3AYiR+l
99Mti89ltTsbsbwxyugYsptsUIXerGr+GmSio+p3wLXHELXvW64Ls1kDu/1p59CT
KnXjAHMOdMdzbj7RHSQ1bPl55KegAfcGjNvppO+rPsmMYJamYjomnOb5jWMIIl9p
PRogcvNoKTObEgB9CesQwewPgI9o4sdOtfWwh4nKnRkYccNaw2Wr+jiFCPojLVGc
6oZadRPfWv5QXRCQiYDGGMLW3QKNrceE4OH9UXx4PeK/13pd8yyz4Tg4nSS/Zuqe
tjWtp5dncEwB7IMjBuLmiTdxo13jeLsEpfTQEeUKJAlmHZqlEdPKBOEbkyRHbBCt
lIVwTCfpIgix5cK/UVXoOd4Gtz6QpXr4wsJklKFD3zSvyymhFQ6bPZ2obXmwav3m
QvxKgq5wgqkg+wRiVi2KdMfPrrFMDe0OVMTlGS6hy3HIL53YqmJZpQxkqfWK++aF
AgwDjkYn/mSG9r8BEACsQy58Ff5amdTKOCtP3xkC3oO0tdVgGGVf4AvceJbeFDUg
RAEgHTOSumI+y6361PISdgwdaoq2yPIhgPcR/1cuTfz4sVddOSlf2KIF90O7/3+P
Az9i/SBMxPKITyLIk2K87lvLWWNKt11v36JMIrtEkeiRoqVTgLq89TplFmmxGQpI
M1ifGv2goImPA87lZ9/KohuMESDOXKQR0xyVTOxLfbU5l/c+YUCjuB+kQJJaEor7
XCKqFp+8LqpPhqF5nonTw2eKMJkBpR+wb9N4eztVrauVSfoC1BC3/map+KFpoPrG
pGAWl1qjgDhrS9DXugvxW9u1syvn0YxzJdU0TSMJFG6lkk68anFt93hNyLRctznL
qqBHtfmgGDvDY64K43pIrm2WsNFV8Obcz0dNrdtlmEuMDPJET+dfXy/gxdl3WvKS
z95mI4bNrS+vUbURRxOQsDwixsdVJSp3eYvNayFjc6eamHtJju3c1XKkZW6qilHl
CzGocqeiWlve11oCJ7CeipALfMbvzIsaD1zaeUQjWYbKXnZlJnL0fsXfC7kAIuwG
XLP6qqswLr/kh+VxPj59fwVXcK1vLRoABfRcn/sGyChEmiL0CO6p0zYx4Aybgf6t
WPZDHaJCu3hmxy/3AghGe+EAq5Qaag5FEELtcNiTLbtC0hjsCaSftf5d9FBV1tLq
AU45kBY9wqrzVHmkKEIAQ936ZChBqpptSgb4MmgbwVlhmF7wtG9x3YFlRKwrdyoy
QFhrJeqco7kWTmn974ihLONy8LCKqOTNXLrndFg0nVG4fNEkJj3cacrF3gLlnML5
Ya2sohY54A/glIbx27NcEY+RSk7aM7lAmUbLuvPWrp0T2U9sKtkLns4cMzXMcctj
qRRxH5weWiZFk2Y2klpKRAyRQpjYdC1Ok4dK4f8X5iQuSNNap2B2TF0iPSUuQbbE
DCEzgsNIQJovD1LTQRZr3KtZz0LhbsTt5qCYsJ+s3ulQSII3fYMp5P/9KJeFZG45
FpMoBn094abq3DN9CsqmHu/6dj+r24CjGTP8jaLJvAJ7gdyBXXiWaIb+SjkzoniH
D34YZciqv4H99XFhfsi2ZUDQn3sE3aTi2HnIWTNYRPp7In5Ea2RQ/20egF4LLXwR
X0kg40afOMYKbDz6f0hXClPlJgf6gayXPc3X9LxVCte4scMW4k3X8KVyvRak24B2
Udfoqvy3YCY9vHSn+aIz7CWjH5Xh/9PD7CGJaHOCSGF7Cued/S+vhREUgb941m25
eKqZxp1Gl0n0P/QUXZhKa7Sv3DIr5/hUvs9pJy20bt8zy2R6ijz+4al2B59eXFuk
TCrAGGfNn3wzVVb5FBxxyG+qhWBJBbxetGTmSE/HNDnfUewAIdkuNL2NagdYGI3R
zW0fDY/SqEJFuK5fkqXaFCGQgVnzN7D7IqdZpHkzo7ZNZ4uZH4QD2+V16M1r0OjN
+uC13NnKVk6UGpp8AyBp3gzViJgBYzp2miAiJY0oaMfVL6mHJHLdlKe8UD55gg3Q
ozhql+fAuIQXEv0QPJcytKPK6wU10jylDH4JiY0EZeowYGqT69ilheBa7AgcsyLv
jHG7+yfgwTKNnK3CjEaUTccvnnAQdck/uvzy6b3MNKFzBvJzgQKjdvuHTc8TNCcM
izSiEXDNIB9dOTMAb/729MkpgNfW2O5ypNU3xM+e2iSbDYXmxr5XtXRd2Co5O1B/
bSG8U7pOIoMKjJJkChE6qeRoF8o8hByjHdmTYl2dAVj8dmi4Tn6Wu9H79QI1KUbD
8mSIaZmU2qyzQo728fnZPdlJ7jvKubVNQr62o+s1fM9eDWRPQMdcRc/aR7Tjl6tG
rUvAA0MgeM2fT53i4TPNDUpE3kIMkr2ESVHbLu/P3WLplIX+VNr8V7xo7kXDm+xU
lUyqgiLWLsHr1dW53q7ToZKqEGSRenifyQGC3b8kF9yrDeLH9MDdZ7ab8P9QyIhx
Y5+UIo2rsPgStIxsKYnXXh1m4Ppp6uQClXiO/QyRVjHX9CV8f2BCaytSd67fXhLF
IS7CAVmopU6/7VzfrlIyrcDiUdn7EzJRLRxRjjIuKBjL0LvLPa4KWfFt/shw+jQ/
VqUgFaDKJEvyc3kIVaqriEajxTQcripqwrYn8Mcn86gHc0L9wWwbu9/dmBteffsN
0hH6ACXG8VFkW5cUylkLup2JWWN/0AZnchZVwkpGSpoJZzTNqtyzVFNOUoWou4Uu
o/Evs3+vvw7bc4ztIa8PvX1ipDnt/Wk7tHnYJsFHxUGwzWTVwEQcqcqsbxH58sZT
OL9JvBExyTm5X0/rdB2Fuq6JmWkyHizb5NCUjJksVERFzKtaAPzYKJwNWRVvgvNa
Dch+KC/XMXRL04S3QTkOl7Ygme5lst6g6U0udEo4uvLqa8eag3FA7+qzGpHYiZIe
5xHe/wbrtlKQHFJu0V1OWqx/94gd1H/wv4H1lqXnfvwvX6iviNzGR5ilUZZAd4CE
oA/krbbl4AJoe1Qio6fAGFL6Ar8PpHMMdWCt26itoOvRtIeH6UboAi3TivrPgI00
iPOat1YM9k7gn18SYU4L06n8Tvkb4Wre0C9ExBg6QpxlOtthS1Iooc2Tl7OOIMKo
7dm9ZA==
=HGM1
-----END PGP MESSAGE-----

P.S. Plan is presently not free, I don't know exactly what it is. But we are migrating off that instance, that's how I found this project.

@rusq
Copy link
Owner

rusq commented Apr 13, 2023

Thank you! I successfully decrypted and checked the JSON, will modify the downloader to skip the "external" files. Looks like these types of files appear when one has come kind of google drive integration, strange that no one reported it yet 🤔 Will have to mess around with this, maybe it would be even possible to fetch those.

TODO:

@rusq rusq added enhancement New feature or request and removed bug Something isn't working labels Apr 13, 2023
rusq added a commit that referenced this issue Apr 13, 2023
rusq added a commit that referenced this issue Apr 13, 2023
rusq added a commit that referenced this issue Apr 14, 2023
#206 and use external fsadapter package
@rusq rusq added this to the v3.1 milestone Nov 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants