Code

Vlm demo hacking#294

Code

Draft

NishanthJKumar wants to merge 33 commits intomasterbdaiinstitute/predicators:masterfrom vlm-demo-hackingbdaiinstitute/predicators:vlm-demo-hackingCopy head branch name to clipboard

+1,479-108

Commits

Commits on Sep 9, 2024

• Initial commit.

  ashay-bdai

  committed
  4e13836

Commits on Sep 10, 2024

• Some more progress.

  ashay-bdai

  committed
  0a25b2d

• Some more progress.

  ashay-bdai

  committed
  e62e8cf

• More progress after pair programming.

  ashay-bdai

  committed
  aed5708

Commits on Sep 11, 2024

• Get plumbing to work.

  ashay-bdai

  committed
  c832fb0

• initial test working

  ashay-bdai

  committed
  ea5f1bf

• Rotate spot camera images.

  ashay-bdai

  committed
  0b8d125

Commits on Sep 12, 2024

• Play-test other VLM predicates and update annotation in spot images.

  ashay-bdai

  committed
  d255810

• making some progress; took way longer than expected though...

  NishanthJKumar

  committed
  803683d

Commits on Sep 13, 2024

• Progress towards object detection result.

  ashay-bdai

  committed
  cf40334

• finish up implementation!

  NishanthJKumar

  committed
  369b399

Commits on Sep 14, 2024

• Get camera annotation + object detection annotation to work on all images.

  ashay-bdai

  committed
  94dff09

Commits on Sep 15, 2024

• Update annotation text font and background.

  ashay-bdai

  committed
  aec3f86

• Run autoformatter.

  ashay-bdai

  committed
  ac9fc2f

Commits on Sep 16, 2024

• Fix indent.

  ashay-bdai

  committed
  5a461cc

• fixes for comments

  NishanthJKumar

  committed
  c4c978f

• autoformat

  NishanthJKumar

  committed
  199698e

• Merge branch 'vlm-pipeline-testing' into change-perceiver-to-have-history

  ashay-bdai

  authored
  9ce43d3

• Merge pull request #293 from bdaiinstitute/change-perceiver-to-have-history

  Show description for 37b5245
  ashay-bdai

  authored
  37b5245

• Add last skill execution to _TruncatedSpotObservation.

  ashay-bdai

  committed
  6e25b72

• Debugging progressm.

  ashay-bdai

  committed
  fe7da30

Commits on Sep 17, 2024

• Some progress towards fixing vlm atom history.

  ashay-bdai

  committed
  4cc0336

• Progress towards passing history into VLM at test time.

  ashay-bdai

  committed
  41b58ea

• Update and fix computation of history and how it gets passed into the VLM query.

  ashay-bdai

  committed
  71fe6d3

• Fix bugs related to image history to VLM and abstracting the state.

  ashay-bdai

  committed
  5232fa2

• Fix skill action history in case of done action.

  ashay-bdai

  committed
  6303130

Commits on Sep 19, 2024

• Progress towards testing cleaning mess demo.

  ashay-bdai

  committed
  15c741d

• Add options.

  ashay-bdai

  committed
  523656b

• Add place broom skill.

  ashay-bdai

  committed
  a60692a

• Fix bugs.

  ashay-bdai

  committed
  ba8d070

• Get sweeping demo mostly working.

  ashay-bdai

  committed
  29242a8

• Fix handling holding in minimal perceiver.

  ashay-bdai

  committed
  7298b93

Commits on Sep 20, 2024

• Push latest code.

  ashay-bdai

  committed
  98a4041