Posted by vrganj 11 hours ago
The military contractor (Vantar/Maxar) in question basically admits so but just "reserves the right" to use the data which is the political battle line ala Claude and DoD.
This is mostly an ideological battle.
Pokémon Go was released at the beginning of July 2016. A week later, the Air Force kicked off its Red Flag exercise in Nellis AFB outside of Vegas. For the several thousand active duty folks participating, this is a month-long TDY from their normal base to Vegas. The premise is a large-scale war simulation, and it encompasses essentially all major wartime functions. I was directly involved in supporting drone operations (including live strikes) during this exercise.
The thing that’s funny about your comment is that because Pokémon go was just launched a week prior, a huge percentage of the participants were playing it in their downtime between exercises. You have to understand: these are thousands of 20/30-somethings (and occasionally even teenagers), meeting back up with friends from all over the world in Vegas. On and off base, people are socializing, having fun, and playing games. While phones were limited to outside of SCIFs, most of the base had no such restrictions. I recall wandering around base at 2am with friends playing it.
What’s funny is the same was happening with our deployed friends as well at the same time. This was a game that all their friends back home were playing, and when deployed, you need all the morale you can get. There were technically OPSEC policies this all probably violated but this was before any blowback from Strava accidentally revealing military bases or other similar incidents, so there was no specific guidance or moratorium on it.
All this to say, I understand what you’re trying to arrive at via deduction, but I think your understanding of the world in this case may be a bit too limited to meaningfully speak to this. That said, is the headline sensationalist? Probably.
If you’ve played the game, the scanning function is only for what they call Pokestops: These are points of interest that you can walk to and get items in the game. The game gives you points if you walk in a circle around one and take a short video.
They’re relatively sparse. At most, they captured some 3D models of some things like signs, small landmarks (up close) and the fronts of some buildings.
The images captured by something like Google Maps are a million times more useful for someone trying to construct a world model with a lot of coverage. The Pokémon Go captures would be useful if you wanted something like a detailed 3D scan of the sign in front the student building or something.
If this is happening it would be easy to detect by the upload bandwidth spiking during AR mode.
The 3D scan mode is a specific feature you have to use in the app that uploads 100s of megabytes afterward. It advises you to go on WiFi to do it.
If the AR mode was secretly uploading images that would be a scandal in itself.
I feel like users and readers instinctively know these limitations. We work with digital maps all the time that are out-of-date. Google and Apple don't and can't know any and all road closure and vehicle accidents in real time. Your car's radar road mapping service is as up-to-date as anything, but you still may be the first person to ever encounter a sinkhole or pothole that just appeared and it won't be on the map until you discover it. Satellite data is even more out of date because it can't be as frequently updated. There aren't anywhere near as many sensors in orbit or aerially as there are on the ground.
I haven't played PoGo in a while, but Niantic used to have human moderators and also tried to crowd-source some quality control on these world models because they knew 99% of the scans they received were bunk, either of nothing, the wrong thing, the right thing but in the dark or from an obstructed angle. I have no idea how good a job they ever did of cleaning that up, but it's a difficult task and it's never done because the world is always changing. There's only so much you can do here. Technology isn't magic.
Currently active theaters. And now there are detailed locations of our cities. We might not get killbots today but we will get pacificationbots.
If GP has access to this dataset it would be interesting to know how sparse is the data in that area.
What time you have in mind, that was really better?
(I believe the 90s were at least way more optimistic)
You can connect any two things into a sentence regardless of the state of the world. This is way off of where the problems actually are.
Edit: Some people have downvoted this without giving a reason, but I'm going to double down. Any time you have disasters or large crimes, you can connect them to children and children's things. Thinking there's anything to learn about the specific fact that you can make that connection is a mistake. It's letting the real problem spill over in a way that misleads your common sense. It's an inherent part of bad things happening that they also affect children. No matter what state the world is in.
This time you have an actual connection, the state of the world notwithstanding. If you factor in the world however, with this many wars, I'd say it's pretty much linked, regardless of the way you assembled words to make it look like it doesn't, and doubling down doesn't make it less distant from reality.
The Pokémon Go data is for small little islands around their points of interest (pokestops).
It’s not a detailed city map. The data is extremely sparse and only covers little tiny bubble around their sparse in game POIs.
The way it was represented as some sort of high resolution city map or world model was quite ridiculous.
That's not the impression I get from the TV ads.
The ads they run show people walking along sidewalks and through forested paths and through parks in AR mode.
Visual navigation is prone to degradation. Keeping the "map" updated requires constant visits. (I know because my team worked on the patent for a method for updating said maps.)
Also Pacification bot would be run by the military who most lilkey have GPS.
Finally, For ground based bots, SLAM is actually more useful, rather than pre-built map based navigation.
That has already existed for decades.
Ground drones however are targeted by the FPV drones (wired or radio controlled), so the new thing is to have a thing with automatic targeting to shoot those. Then again, I at least heard about using something open-cv (yes, some of those run actual linux) shaped on the FPV drone itself, as it really helps with the amount of jamming going on.
> “We tried it,” says drone-maker[…]. “It’s a test. We never implemented it [more widely].”
“We just launch it and we know everything will be dead – everything that will be found there in this particular area will be dead,” says Kokhanovskyy. “There is no connection to the drone at all, you cannot see the video, nothing… Everything it sees will be killed.”
Because there are never any civilians caught in the middle of two warring armies, right? I think the ICC will be getting real busy soon.Civilians dying in an armed conflict doesn't cut the definition of warcrime by itself. Deliberate targeting and intentional destruction of civil infrastructure that supports life or something like it is.
Then of course there is stuff that ICC isn't getting busy about which is clearly above the threshold -- the regular drone safaris in and around Kherson (city with pre-war population circa quarter million people) happening for the last few years.
Everything! Everything! Like all the deer, all the rabbits, all the decoys! Obviously we trust Kokhanovskyy
How likely is your opinion to change in the light of the information that, according to the article, it's Ukraine who uses these drones?
The ICC judges have less real-world power than a Pop Idol judge.
The ICC only works if every nation plays by the rules. Fewer and fewer do these days.
Pessimistically, maybe democracy's days are numbered
that was in the cards in the early 2000s when the Patriot Act got passed, mate.
now they just have the muscle (drones) to back it up.
welcome to the cyberpunk dystopia
There are clear parallels in the modern world of societies when the ruling machinery doesn't need those things from their population - petrostates. The people in these states tend to be viewed as subjects, not citizens. That's where we are headed
A corporate council of emperor kings with armies of pacification bots. The tiny sliver of window we have to ensure this doesn't happen is rapidly closing and there seems to be no movement toward ensuring that this doesn't culminate with the entire power of this new revolution in the hands of a small class of near demigods.
i think killbots are absolutely a possibility, and very soon.
rightwing pundits and meme makers are already unironically quoting Zechariah 13:8
But presumably the images/models at ground level can be used to train/improve the general performance of Vantor's aerial (satelite based) navigation system so it works better elsewhere?
It almost 1-1 data correlation, n-phone Pokémon go scans of a location helping a drone locate itself in the same location in correlation with Maxar’s satellite data.
There maybe some hyper corner case uses. Maybe the billion scans in New York City help them generalize across different phone lenses characteristics, but phone and drone lenses are so different.
Would love to hear some specifics if I’m wrong here.
there was a startup that pitched the idea of using Satellite data to do ground based navigation. (https://sturfee.com/vps) they didn't get bought out by either google, niantic or facebook, so it can't of worked that well.
Niantic's stuff is a pre-built map that the client will reference to get a position. Its essentially a massive feature matching exercise. The problem with using airborn photos is that you miss a bunch of features you can't see. (samy thing trying to match ground features from the air.)
THe lens calibration issue isn't actually that much of a problem _for the client_. if you have a rough idea of the lens (exif data really helps there) then you can still get meter accurate (and a few degrees heading) its a bit more of a problem for generating the initial map, but Structure from motion with good motion priors goes a long way to make it less of a problem
Now, Niantic are proposing that you can train a model that can relocalize generally without a detailed map, I think thats a bit far fetch, especially to do at any large scale. (ie bigger than a cubic kilometer)
The headline, which I do understand is in question, talks about training, not using the scans as a database. It is likely that you are right that the scans are not being used to provide localization data, but that is also not what the headline is pointing to.
The headline specifically speaks to using the scans for training. While I do not have any inside baseball, the problem space is often solved using neural nets and other machine learning algorithms. On the surface it seems likely that they would benefit from training data that doesn't necessarily need to be from where the conflict is actually taking place. A base world model, for example, can be developed from data collected anywhere in the world. Its is not an entirely different universe when you step into another country.
But you are suggesting that the algorithms used are entirely classical (i.e. no AI/ML)?
"get data for drone warfare" ...in 2021 (before the russian invasion...)
but did we even EXPECT drone warfare to influence the war THIS MUCH back then?
well not me -- I actually thought russia would beat the crap out of ukraine within a month (even after the failed spetsnaz attack on zelensky)
the article's assumptions only makes sense IF some people had time machines, or if CIA has some know-everything future prophet
(not to mention: drones need TOP TO BOTTOM view, not bottom-to-top view)
anyway, my verdict: sensational yellow journal article, nothing more/less
but... drones? that's just yellow journalism optimized for SEO keyword (and anyone who clicks an article with 'drone')
Is Pokémon Go not played in the Middle East, India, Taiwan, Korea or Japan?
The only place I can imagine is maybe Ukrainian drones in Russia. Still, not a tonne of data there to be useful (as compared to say Tokyo or New York).
All of them but Japan?
MEA has stuff going on beyond Iran, Lebanon or whatever country the US decides to invade this week. India has two nuclear neighbours with border disputes and weekly scuffles, sometimes a downed jet fighter or two. Taiwan is probably the biggest geopolitical tension/war/invasion possibility of our time. Korea is in a stalemate unfinished war for decades. Japan has its own very real dispute scenarios with China.
I know drone scans from Pokemon Go probably won't help in the Himalayas or South China Sea, but those regions are far from trouble free
Works less well if you want to use structures for radar cover.
ofc going by the entire surface of the earth its not a lot of places, but i would never call such a thing statistically insignificant..
There's even a Pokemon exclusive to the middle east region: sandstorm pattern Vivillion. Lots of players there.
Maxar is/was primarily a satellite data company, and to say Pokemon data would add any major value in any of today's active drone deployments with the level of Satellite coverage Maxar already has is a wide stretch.
Moreover, ground forces in the area would need pretty heavy jamming tech in place too for this kind of data to be useful. It's a sliver of a sliver of a sliver situation.
According to Wikipedia, more than half of the Middle East countries are either belligerents or were otherwise attacked in the ongoing war.
But what I mean is that there are enough players there to be significant part of the ecosystem. The war made obtaining those Vivillion harder.
I am a daily player, I have scanned something once, the rewards were minuscule, I never did it again. I have that specific vivillon which was hard to get because not many players were from the relevant area even before the current events, and I just can't see how the war is related to any of this.
For now.
rapid 3d modeling of topography and cityscapes + supplementation with other data, e.g. pokemon. But ultimately that's supplementation, not the main effort.
That could change in an instant.
Also Vantar: "The superpower of generative AI is that data in one task generalizes to other tasks!"
If you train a soldier in the US, is he unable to do those things outside the US?
Can you elaborate?
GPS can be faulty in cities.
Pokémon Go scans, are primarily in cities.
The mapping in the article, is specifically saying to use visual cues when GPS is faulty.
How is this not directly 1-1 overlapping, the gap and the solution.
However that data has a half life and needs to be refreshed.
For flying drones, ground level data is really not that useful. mainly because you can't see it, because its obscured by trees, building and clouds.
But, this is not a new thing. Google, Apple, facebook and niantic all have VPSs as do a bunch of other startups.
For Drones you will probably need SLAM to capture the map, and then once you have the initial map, you can keep it updated.
You can experiment at home using https://github.com/colmap
Like you see in drone races. But with a little bomb attached.
Even with half life. That could be years. Depending on changes. Old neighborhoods probably haven't changed.. And, not sure I read that deal had a cutoff, or not. Could they continue getting updates. ?
are you saying that drone training in quiet residential neighborhoods is not training? are you saying self driving cars can only drive in theaters where they've been trained, because autonomous training is always specific by neighborhood? are you saying that if a particular region has some novel terrain that all previous training must be discarded?
The United States is one pretty warmongerish nation by any account.
Compared to other modern nations, but compared to history vary peaceful.
It is not childish to aspire to be better.
Seems to me that most of our friends in the balkans that have memory of the past wars are overall pretty happy about the current state of things, and there hasn't been wars to contend Alsace-Lorraine in 80 years, is it a record already?
War is very much not a given in the civilized world
Powerless without american hardware and intelligence: You wish. Big tech is spending so much lobbying our governments in fear of us leaving them for open solutions, or god forbid paying fair amount of taxes.
And regarding intelligence, we would have been so much better without the CIA & co spying our politicians and messing with our governments, aiding and sponsoring domestic right wing terrorism for the past 50 years.
the only reason we dont have antimatter weapons or gravity guns is because we haven't figured out how.
That's the state today. Throughout history there's been a long negotiation about what weapons have been allowed in combat.
It's a feature of open data, it's open and usable by anyone.
MapComplete is a nice alternative if you care about some part of the map that are not easily filterable by StreetComplethttps://mapcomplete.org/
That was the initial objective, improving navigation by having people walk slowly on pedestrian accessible locations instead of only the main roads. But once that data is collated, it could go anywhere and you've signed any rights to what happens with it away when you agreed to the Ts & Cs.
I seriously loath, hate & despise everything about this digital panopticon world being constructed around us.
Even 100s of yummy grandma-cheeseburgers is not worth feeding private data brokers detailed maps of our own communities.
Nowadays some of them are just as likely to sell the data to the other side.
Nowadays the other side may get access to them without us even knowing.
Yep... collecting domestic geo data is a double-edged sword.
Counterexample, guns could be a (non-violent) hobby. I’m not pro guns or violence but just pointing out the logical issue here
Guns feed families and protect people too.
They are dual use like all tech from knives to nukes.
All uses of guns are violent. That's what they do. They make holes in things that didn't have holes in them before. There are uses for them that are justified but they're always violent. This isn't an anti-gun screed, this is a words-mean-things rant. Violence is necessary and justified in various situations, which means guns are necessary and justified in various situations, but if you're going to say they're not violent, I can't agree.
Or perhaps can we accept that it is possible to make holes in things without doing violence, and that an object that can make holes in things is not inherently a violent object even though it would be violent if you made holes in things like people or animals, or in property without permission.
Targets are inanimate objects I’m fine with being violent against them just like I’m fine with farting on my chair!
Even if all uses of weapons are violence, sometimes violence is justified. If you disagree happy to violently rob you and disabuse you of your stupid ideas.
Opinions of people who lived sheltered lives are so divorced from reality
I guess this also explains how they were paying for the free 3d model photogrammetry processing that app does.
I was interviewed for the Trouw piece and briefly quoted. This isn't to detract from the DroneXL piece, which adds its own angle.
There is a level of evilness on that difficult to grasp. What kind of society puts that burthen on their own children?
Inequality has given power to the few deranged and depraved. No ethics, no morality, just self gratification and excess.
Also in that worldview, we have the responsibility to defend innocent children. Let's if they can follow their own moral code and outlaw this surveillance to protect our kids.
A story was manufactured about arresting a 22 y.o. guy in the Church on Blood in Honour of All Saints for playing Pokemon Go.
The story went hyper-hyped for weeks, with general public sentiment that once such an obscurant retrograde declares such an innocent game so evil, it must be something to absolutely install and play in spite!
And such was the way of the Pokemon Go's viral success in Russia.
(edits for factual precision)
Like in that case when he blamed the rise of toll roads in Russia - "oh brothers and sisters, shalt we allow taking the toll on what should forever be free in Russia?" - the public reacted in the exact same way - a religious zealot told this, so it must actually be a progressive, sane thing to do the opposite.
It should also be pointed out that Kirill and the Russian Orthodox Church have been understood to have been cat's paws for Russia's notorious KGB successor agencies for a very long time now.
> the Russians are calling "our partners", "our would-be enemies" now.
is a total wind vane which can flip 180° in a matter of days (if not minutes, as in Orwell's scene where they seamlessly switch from being at war with Eurasia to that with Eastasia)...
Only propagandists and their victims can throw rocks like this without any discernment.
Any nation is a collection of vastly different personalities, out of whom one could of course pick a group with sought after characteristics, but taking one such group and extending its characteristics to the whole nation is beyond stupid.
"Nazi" -- in Russia -- means anybody that Russia hates, resents, is jealous of, or otherwise dislikes. Anybody not explicitly in Russia's thrall is "anti-Russian", considered an enemy, and is hence labelled a "Nazi".
Coincidentally, this "Whoever isn't with us, is against us" thinking is a hallmark of fascist regimes like the actual Nazi Germany, where it was an article of faith.
Can you do better?
Governments have a say on to whom their weapons manufacturers sell weapons. It should be ditto for geospatial intelligence. If you want to map geospatial data in the Netherlands, you get a license from them and store the data locally and have to get permission to exfiltrate.
This won’t stop exfiltration, of course. But it should slow it down, which in the world of geospatial intel, could mean the difference between a drone finding its target and getting lost because of new construction.
But the value in that data is in the liveliness right, so at some point, would it not make sense for that data to be considered a public asset?
Why do we not demand this data be released regularly (given that the inverse tech could be developed using this as well)? If it can be used to train things used for war, could it not equally be used to train better lifesaving tech (in which case, the data should be made available to the public)?
The story here however I'm not too sure about: Isn't the game mostly played in dense urban areas? - by the time you need military drones there the area will have changed a lot (destruction, fortification, ... and overall be outdated) where I think the civilian drones (delivery, cars, ....) benefit more. While the technology certainly is dual use.
I am not joking though, I really would consider any data generated on public assets to be considered "releasable" to the public. How many people should get killed by self-driving cars because the company making the cars didn't have enough data to train proper models?
This may be good and we'd still not have the data (but "they" can collect on their own privately/secretly)
It's dual, but its positive aspects are only unlocked after a sufficient human blood sacrifice is made by its overlords, as is the case with all dual use tech.
There is no 'we'. 99%+ of people view the world as a zero sum game where for me to win, somebody has to lose and if I don't do whatever it takes, somebody else will and then I lose, therefore I have no morals or principles or virtues and anyone who does is a liar or a fool.
Everything is a bad faith act, everyone is a selfish bad faith actor and I shouldn't feel bad about being one because everyone else who isn't a fool is too.
This tragically wrong but intuitively correct worldview and much more was explained by Plato long, long ago and just about no one understood any of it. At least the text survived and people with 140+ IQ and an iota of decency can read it and be at peace knowing they're not crazy or foolish.