fix: use custom base64 decoder to workaround deno bug

[markwylde]

This PR works around issue #381, a bug that appears to be in Deno:
denoland/deno#19546

It uses a custom base64 function, but maybe we could find another library out there that doesn't use the built in atob.

[lucsoft]

Wait does the std base64 encoder also has this issue or just atob?

[markwylde]

Yeah the std base64 encoder uses atob [1], which it looks like is broken unless I've misunderstood.

1. https://github.com/denoland/deno_std/blob/main/encoding/base64.ts#L151

[lucsoft]

you are converting a URL Safe base64 to an actual base64?

so you issue is that you don't actually use a base64 string, but you use a url safe base64 adoptation.

base64 uses / and + by default. so the current impl is not wrong. we just expect actual base64 strings

do you require a url safe base64? / is this per mongodb driver spec?

[markwylde]

I think it's a really good question lucsoft, but I don't have the answers unfortunately.

I have managed to create a small script to recreate the problem:

import { MongoClient } from '../mod.ts';

for (let x = 0; x < 100000; x++) {
  const client = new MongoClient();

  const url = `mongodb://testadmin1:testpass1@localhost:27017?directConnection=true`
  console.log('url:', url);
  await client.connect(url);

  await client.close()
  console.log('');
}

Run that, and within a few seconds it will throw:

deno-mongo % deno run --allow-net demo/main.ts
url: mongodb://testadmin1:testpass1@localhost:27017?directConnection=true

url: mongodb://testadmin1:testpass1@localhost:27017?directConnection=true

url: mongodb://testadmin1:testpass1@localhost:27017?directConnection=true



url: mongodb://testadmin1:testpass1@localhost:27017?directConnection=true
error: Uncaught (in promise) Error: MongoError: "Connection failed: Failed to decode base64"
      throw new MongoDriverError(`Connection failed: ${e.message || e}`);
            ^
    at MongoClient.connect (file:///deno-mongo/src/client.ts:46:13)
    at eventLoopTick (ext:core/01_core.js:178:11)
    at async file:///deno-mongo/demo/main.ts:8:3

[markwylde]

I'm still not sure what's going on, but if I edit the scram.ts file

Then run my script above, I get:

url: mongodb://testadmin1:testpass1@localhost:27017?directConnection=true
parsedResponse= { v: "" }
decodeBase64 Uint8Array(0) []

url: mongodb://testadmin1:testpass1@localhost:27017?directConnection=true
parsedResponse= { v: "" }
decodeBase64 Uint8Array(0) []

url: mongodb://testadmin1:testpass1@localhost:27017?directConnection=true
parsedResponse= { v: "XwftqO5acqzP3qfL6HMwI" }
error: Uncaught (in promise) InvalidCharacterError: Failed to decode base64
  const binString = atob(b64);
                    ^
    at atob (ext:deno_web/05_base64.js:28:16)
    at Module.decode (https://deno.land/[email protected]/encoding/base64.ts:138:21)
    at continueScramConversation (file://deno-mongo/src/auth/scram.ts:206:35)
    at eventLoopTick (ext:core/01_core.js:178:11)
    at async Cluster.authenticateToServer (file://deno-mongo/src/cluster.ts:86:7)
    at async Promise.all (index 0)
    at async Cluster.authenticate (file://deno-mongo/src/cluster.ts:55:23)
    at async MongoClient.connect (file://deno-mongo/src/client.ts:37:7)
    at async file://deno-mongo/demo/main.ts:8:3

It's strange, the ones before have a blank parsedResponse, seem to work. But when data get's returned it fails. What is that data?

[lucsoft]

this is not a fix this is a feature request. is this per spec? 😄 Hope we can resolve this together :)

if you have any questions feel free to ask

[markwylde]

this is not a fix this is a feature request. is this per spec? 😄 Hope we can resolve this together :)

if you have any questions feel free to ask

Sorry, I'm happy to rebase to any commit message appropriate for this.

[opimand]

Some fix? Can't use Mongo with Deno by default