Automatically set the end_date on memberships that were not part of the last import

[jpmckinney]

This functionality can be "opt-in". Curious to hear from others re: implementation.

[jamesturk]

this is an interesting idea for sure, i'm a bit nervous about all the weird hiccups that happen on a site marking someone as removed from office without human intervention

brainstorming on how it'd work I think there'd be a "scrapes_everyone_currently_in_office_i_promise" flag on the scraper that the importer would find out about somehow, if that was set it'd trigger a function that disabled everyone that wasn't in that scrape

[jpmckinney]

That would work for me.

Is there anything like Merge-o-Matic planned for Pupa?

[jpmckinney]

This is still an important need for Represent. Wondering what current thinking is. /cc @paultag

[paultag]

Hurm, yeah, interesting.

Too bad we don't have billy-like terms for the Legislator scraping, that would let us flip the date if we're at a session break (which I think Billy did)

I think @jamesturk 's idea is likely spot on, I am a bit sketchy on this as default, since we do have site hiccups that end up dropping people, and I'd hate for them to get set to retired / historical.

A flag isn't unreasonable

[fgregg]

I think this should not be done. I do think there should be a pretty lightweight way to declare terms particularly for former members. Maybe a YAML file.

[jpmckinney]

@fgregg It can be opt-in.

[jamesturk]

I think an opt-in setting on the scraper is the way to go.

I admittedly don't have a near term need for this but very open to patches in the interim.