Top
Best
New

Posted by gnabgib 6 hours ago

College instructor turns to typewriters to curb AI-written work(sentinelcolorado.com)
124 points | 131 comments
erelong 2 minutes ago|
Things like this are well-intentioned but idk why there aren't more teachers creating optional "side quests" like these for students that want them instead of forcing them to do things like these

optional "side quests" would allow teachers to create some standard accepted "main quest" curriculum and then just create a bunch of (even possibly "fun") "side quests" students can work on in their spare time for extra skill development

throwatdem12311 3 hours ago||
When I did my Computer Science degree the vast majority of courses were 50% final, 30% midterm - even programming exams were hand written, proctored by TAs in class or in the gymnasium - assignments/labs/projects were a small part of your grade but if you didn’t do them the likelihood you’d pass the term exams was pretty darn low.

We already had AI proof education.

stingraycharles 2 minutes ago||
Yeah exactly, I remember having to write Java and C++ by hand in college in the early 2000s. It was also a good test how well you knew the syntax.
nsyne 3 hours ago|||
I personally dislike placing a heavy emphasis on exams. Assignments/projects have been consistently the most enjoyable and rewarding parts of the courses I've taken so far in university.

It's a shame that they are also way more susceptible to cheating with AI.

syntaxing 2 hours ago|||
I went to college as a MechE so unsure if compsci was different. But overall, all the “fun” projects were labs. We have three semesters of hell and all 3 semesters had 2-3 labs, and we write 20 pages or so for EACH lab a week (usually a team of 2-3).
gpm 2 hours ago||||
Also way more susceptible to cheating in traditional non-AI ways. And your mark ends up depending a lot on how much time you have to invest independent of how good you are at the course material.

Assignments and projects are great for learning, but suck for evaluation.

lokar 2 hours ago|||
I really appreciated classes where there was rapidly demising returns to time spent :)

Another example, lit classes where the grade is based on time limited, open book exams, hand written in "blue books"

Read the book, pay attention in class, spend 90 min writing an essay, and you are done.

jason_zig 1 hour ago|||
is evaluation that important? ultimately if you can't do the work you're only cheating yourself in the long run...
antonymoose 2 minutes ago|||
You say that but I was a Class of 2013, aka during the massive hiring boom of the teens. I tutored a friend of mine with a Ds get Degrees mentality who eventually graduated and now works an ass-in-seat job for Booz Allen or one of those types. I used to joke about it with another friend, that his diploma ought to include an asterisk and a half dozen other names for how much we ultimately did on his grades take homes. I’m pretty sure he makes about the same as me by now purely on tenure.

Personally, I dropped out despite a full ride+ becuase why would I put in work for a no name state school when I already has an FTE job as a developer out of high school anyway.

Turns out fraudulent action can still get the bag.

II2II 1 hour ago||||
Part of the purpose for evaluation is to provide feedback. I'm not going to claim that the form of feedback is great, but it does offer motivation to improve.

The other thing that feedback feeds into is credentials. I realize that some people are dismissive of this aspect of the degree, but it is important to pursue further studies or secure a job. While you can argue that these people are only cheating themselves, and some of them are cheating themselves, a great many will continue to cheat as they advance in academia or the workforce. In other words, they are cheating others out of opportunities.

musicale 1 hour ago||||
That is the traditional view, the view of those who want to improve their own knowledge and abilities, and presumably the view of those who would like to consider the degree to be a meaningful credential.

However I suspect that there are many who 1) are more concerned about the short term outcome, 2) consider the degree/diploma to be little more than a meal ticket or arbitrary gatekeeping without any connection to learning, 3) view the work as a pointless barrier to being handed said diploma, and/or 4) don't see the value of human learning in a world where jobs are done by AI and AI systems routinely outperform humans on complex tasks.

jmye 1 hour ago|||
Yes. I care that the work I've done and what I've learned is actually good and correct. Vibes-based learning/anything is valueless.
fma 2 hours ago|||
Then I suppose we can go back to having computer labs that can only access white listed domains and other study materials. Students code there to ensure no cheating.
zdragnar 1 hour ago||
The labs I was in weren't connected to the Internet at all, only a local intranet. Though, they were all running pre-oracle solaris if memory serves, so I'm probably dating myself a bit.
BobbyTables2 1 hour ago|||
Today just teachers walking around during an exam instead of browsing on their phone would do wonders…
ghighi7878 2 hours ago|||
Writing programs by hand is something I had to do too. Compete waste of time
SamHenryCliff 59 minutes ago||
[dead]
ninjahawk1 24 minutes ago||
In one of my classes the approach was the opposite, I’m expected to do Ph.D level work as an undergrad and am expected to use AI.

In a different one she just said so long as you say AI was used you’re fine to use it.

In the rest of them AI is considered cheating.

To say we have discrepancies in the rules in an understatement. No one seems to have the exact answer on how to do it. I personally feel like expecting Ph.D level work is the best method as of now, I’ve learned more by using AI to do things about my head than hard core studying for a semester.

terrabitz 12 minutes ago||
It's not inherently contradictory, just like using a calculator could be considered cheating depending on the context. If you're just learning basic arithmetic, a calculator is cheating since it shortcuts the path to learning. OTOH in calculus, a calculator is necessary. You still have to have a deep understanding of the concepts and functions to succeed.

It's still a new tech so I'm not surprised a lot of teachers have different takes on it. But when it comes to education, I feel like different policies are reasonable. In some cases it's more likely to shortcut learning, and in other cases it's more likely to encourage learning. It's not entirely one or the other.

Moonye666 9 minutes ago||
[dead]
raincole 20 minutes ago|||
Now at least you're an adult already. Imagine what mixed messages schoolchild's are receiving from their teachers...
leptons 19 minutes ago||
>I’ve learned more by using AI to do things about my head than hard core studying for a semester.

How do you know you actually learned, instead of being fed slop by the AI that isn't true at all? If you didn't study, then I doubt you'll really know if the AI is lying to you or not. I have to wonder if your teacher will too, sounds like they have kind of checked-out from actually teaching.

whartung 4 hours ago||
What's interesting is that as I understand, folks are using things like Google Docs for papers, and that it's (apparently) straight forward to do analysis on a Google Doc to see, well, the life of the document. How it was typed in, how fast, what was pasted and cut back out.

My understanding is that the Google Doc is not a word processing document, it's an event recording of a word processor. So, in theory, you could just "play back" watching the document being typed in and built to "see" how it was done.

I only mention this because given the AIs, I'm sure even with a typewriter, it's more efficient to have the AI do the work, and then just "type it in" to the typewriter, which kind of invalidates the entire purpose of it in the first place.

The typing in part is inevitable. May as well have a "perfect first draft" to type it in from in the first place.

And we won't mention the old retro interfaces that let you plug in a IBM Selectric as a printer for your computer. (My favorite was a bunch of solenoids mounted above the keys -- functional, but, boy, what a hack.)

TaaS -- Typing as a service. Send us your Markdown file and receive a typed up, double spaced copy via express shipping the next day!

nlawalker 4 hours ago||
Typing as a service is a whole cottage industry on Etsy.
ssl-3 2 hours ago||
That's certainly one way to abstractly automate a task: Just pay someone else to do it. (This is a concept that regular people employ every day in the real world.)

Another way to automate this particular task is that some typewriters have (serial/parallel) ports to connect to a computer. It's not a daunting task at all for a student who is skilled in the art of using the bot to have one of these typewrites be the output target.

Like this: https://chatgpt.com/share/69e405db-1b44-83ea-baf3-6af41fe577...

vunderba 3 hours ago|||
Even Microsoft Word stores revision history inside .docx files, and that’s been used to expose plagiarism. I heard about one case where a student took an existing paper (I believe from a previous year/student) and pasted it into Word. They then edited it just enough to make it look different.

However, they didn’t remove the embedded revision history in the .docx file they submitted, so that went about as well as you can expect.

eichin 3 hours ago|||
Hmm, I have some old daisy-wheel printers in the closet that I've been meaning to strip down for stepper motors, maybe I should refurb them instead :-)
djmips 3 hours ago||
In general I love the idea of turning printers into typewriters. I've been thinking about how to do it with an inkjet printer.
tejtm 3 hours ago||
arms race....

oh look there is a llm trained on key loggers to spew slop at your personally predicted error rate; bonus if it identifies to USB as keyboard.

vunderba 3 hours ago||
You should look up the history of the Loebner Prize [1]. There’s a shocking amount of technological development in some chatbots that went toward simulating mistakes and typing patterns to make them seem more human-like.

In some of the later Loebner competitions, when text was transmitted to the human character by character, the bot would even simulate typos followed by backspacing on screen to make it look more realistic.

https://en.wikipedia.org/wiki/Loebner_Prize

djmips 3 hours ago||
Wow it feels like the Loebner prize went away right at the dawn of the LLM. Is it correlated?
vunderba 3 hours ago||
Yeah I definitely think LLMs contributed to its demise. To be honest, nobody in academic AI circles took it very seriously, because it kind of devolved into a contest over who could create the most convincing illusion of intelligence.

Participants spent more time polishing up the natural language parsing aspects in conjunction with pre‑programming elaborate backstories for their chatbot's bios among other psychological tricks. In the end, the whole competition was more impressive as a social engineering exercise, since the real goal kinda became: how can I trick people into thinking my chatbot is a human?

But reading through some of the previous competition chatbot transcripts still makes for fascinating reading.

leptons 14 minutes ago|||
>because it kind of devolved into a contest over who could create the most convincing illusion of intelligence.

Isn't that really what all these AI companies are doing too? It sure seems like it is.

artikae 1 hour ago||||
Goodhart's Law vs the Turing Test! Can our humans accurately evaluate intelligence, or will they be fooled by fakes? Live this Sunday!
djmips 2 hours ago||||
I think it would be great to be revived with a different premise.
Moonye666 7 minutes ago|||
[dead]
RhysabOweyn 3 hours ago||
Why are people promoting the idea that exams are not written or given in person anymore? I graduated relatively recently and maybe had 1 take home exam during my entire education. Every other exam was proctored in person and written. The professor who made the take home exam also made it much more difficult than a normal exam so I would not really say it was easier than a normal in person test.
ryukoposting 3 minutes ago||
Things have changed drastically since COVID-19, at least in the US. Tons of schools and universities shifted to online systems, and never abandoned the systems they built up when it was time to go back to school.

I graduated in 2020, so I've only gotten to see the changes secondhand through friends and family who are teachers, and through my sibling who graduated a few years after me. But the difference is staggering.

dublinstats 3 hours ago|||
Take home exams were very common when I was in school, which was before you could get answers on the internet. After internet answer and cheating sites came along, a professor would have to either not care and let cheating run rampant, or struggle to constantly make unique new kinds of take home questions somehow. AI has basically killed that option too.
phoronixrly 2 hours ago|||
Did you by any chance graduate before the COVID-19 pandemic?
bmitc 2 hours ago||
I loved take home exams because they allowed me to study before hand but not have the insane pressure and condensed studying required for exams in the classroom. Even though they were normally much harder and longer, I liked them. I felt I learned much more through them because I could take the time to understand concepts I had missed without feeling the time pressure of in-person exams.

It's a shame that humans find a way to cheat ourselves out of things that benefit us by over "optimizing" the wrong things.

ghighi7878 2 hours ago||
Exams in classroom with all the time pressure is also an important part of education. May be they should be low percentage of grade to prevent too much stress but it's am important learning experience
beej71 2 hours ago|||
I'd like to see some data on this. My general-ed recall is minimal, and in programming before school, I certainly learned a ton more by coding than by testing. That's my perception of my time in school, as well.
bmitc 2 hours ago|||
I disagree. Take home exams represent how work and progress occurs in the "real" world. There's nothing in the post education world that resembles in-person exams.

Maybe the medical profession is a counter example.

close04 39 minutes ago||
> There's nothing in the post education world that resembles in-person exams.

I’d argue that dealing with any high criticality operational incident is like an in person exam (maybe even the most difficult kind, the open book one) if you are the one responsible for fixing it. Everyone is looking at you, you have time pressure to solve it ASAP and you can’t afford the time to dig through all the docs on the spot. So there’s at least some similarity with some real life situations.

recursivedoubts 5 hours ago||
I used to make my classes 60-80% project work, 40-80% quizzes all online.

I now do 50% project work, 50% in person quizzes, pencil on paper on page of notes.

I'm increasingly going to paper-driven workflows as well, becoming an expert with the department printer, printing computer science papers for students to read and annotate in class, etc.

Ironically, the traditional bureaucratic lag in university might actually help: we still have a lot of infrastructure for this sort of thing, and university degrees may actually signal competence-beyond-ai-prompting in the future.

We'll see.

zamadatix 4 hours ago||
I always preferred the "you get some grades along the way to gauge your progress but the lion's share of the weight went to the proctored exams" method unless the lion's share of the normal work was also proctored anyways (at which point it doesn't really matter how it's done).

The reason was less for myself and more because anything group related suddenly shot up in quality when the other individual work classmates were graded on couldn't be fudged.

bee_rider 4 hours ago||
The things I don’t like about putting too much weight in the exams are:

* It’s sort of unnecessarily high stakes for the students; a couple hours to determine your grade for many hours of studying.

* It’s pretty artificial in general; in “real life” you have the ability to go around online and look for sources. This puts a pretty low ceiling on the level of complexity you can actually throw at them.

II2II 9 minutes ago|||
> It’s pretty artificial in general; in “real life” you have the ability to go around online and look for sources.

Sort of. In real life, you are expected to have immediate knowledge of your field and (in some environments) be able to perform under pressure. I'm not going to pretend the curriculum is a perfect match for what people should know, but it does provide a common baseline to be able to have a common point of reference when communicating with colleagues. I would suggest the most artificial thing about exams is the format.

> It’s sort of unnecessarily high stakes for the students; a couple hours to determine your grade for many hours of studying.

I don't like dismissing the ordeal of people who face test anxiety, but tests are not really high stakes. There is a potential that a person will have to repeat a course if it is a requirement for their degree. At least at the institutions I attended, the grade distribution across exams and assignments, combined with a late drop date, meant that failing a course was only an option if you choose it to be. A student may be forced to face some realities about their dedication/priorities, work habits, time management, interests, abilities, etc.. It may force a student to make some hard decisions about where they want their life to lead, but it does not bar them from success in life. And those are the worse case scenarios. A more typical scenario is that you end up with a lower GPA.

acbart 3 hours ago||||
Exams happen all the time in real life. Or rather, situations where you can't just look up fundamental knowledge. Job interviews, presentations, even mundane work tasks - all these require you to know the basics quickly "The basics" are relative, of course, but I often point out to my students: "you don't care if your doctor needs to look up the specific interactions of your various meds. You do care if you see them googling 'what is an appendix'." Proctored, in-person exams are the only reliable mechanism we have for ascertaining if a specific individual has mastered key fundamentals and can answer relevant questions about them in a relatively timely fashion. Everything else is details and thresholds - how fast do you need to be able to recall, how deep, what details are fundamental. From there, I think it's fine to hate poorly made exams, and it's a given that many folks making exams have no idea what they're doing (or don't have the resources to do it right). But the premise of an exam is not completely divorced from reality.
deepsun 3 hours ago||||
I think it's all about speed. In "real life" everything can be looked up, but exam optimizes to not even having to look it up. Then any research becomes much faster.

Whether it's good or bad I don't know, I think US higher education focuses too much on ability to produce huge amounts of mediocre work, but that's the idea behind exams.

eichin 3 hours ago||
One of the reasons I've always encouraged software people to learn to touch type has nothing to do with typing speed - it's about reducing/eliminating the cognitive load of typing, you want to be thinking in expressions (sentences) not letters. (The increase in effectiveness comes from not getting distracted by the mechanics of typing...)
simpaticoder 3 hours ago||||
In real life you need to know the options and their trade-offs to solve a given problem. You don't need to know all the techniques perfectly, but you do need to be able to characterize them and compare them, from rote memory.
acbart 3 hours ago||
I agree, I think many people who rail against exams underestimate how important memory is to more complicated skills. How can you debug a complex application if you have to keep looking up every operator and keyword in the language you're using? It'd be like trying to interpret poetry in a foreign language but you have to look up every single noun. I'm not saying people can't do it, but it's tedious, slow, and you probably wouldn't think of them as a "professional worth paying for their service". Some amount of memorization is key.
dublinstats 3 hours ago||||
High stakes artificial exams can help prepare you for artificial stakes at job interviews where you need to crank out a working solution in 30 mins with jet lag and someone looking over your shoulder
ssl-3 2 hours ago||
That's true. They do better-prepare an applicant for a job that filters on a person's ability to accomplish arbitrary things in a vacuum that is completely disconnected from the real world.

That's probably a good thing to filter on for, say, the navigation role on all kinds of crafts (from land to sea to space). There are naval roles where navigating with a sextant and memory is an important skill to have, and to test for.

But that operating-in-a-vacuum skill doesn't relate well to roles that don't need to exist in a vacuum. In most of the jobs in the real world, we get to use tools -- and when the tools go out to lunch, we don't revert to the Old Ways.

When an accountant's computer dies, they don't transition back to written arithmetic and paper ledgers. Instead, someone who fixes computers gets it going again, and they get back to work as soon as that's done.

dublinstats 2 hours ago||
Obviously they're both supposed to be proxy measures, not realistic scenarios. I was mostly joking before but I do think exams provide a pretty good proxy for ability in the subject if the teacher is decent. Interviews not so much unless the applicant is similarly prepared with foreknowledge of what they will be tested on and had some time to prepare and given recent practice.
zamadatix 3 hours ago|||
This is where the alternative of a course with the other (still monitored for graded activities) option comes in. The downside of that tends to force in person synchronous rather than custom scheduling of regular tests.

The point is more about whether the graded work is actively reviewed than which individual choice is ideal or not though. Whether it's electronic or written, remote or in person, weighted towards exams vs continuous are all orthogonal debates to the problem of cheating/falsely claiming work.

I had attended a few courses over a decade ago and just completed a degree recently. The methods of cheating have changed, but not because of pencils vs keyboards.

acbart 3 hours ago|||
So at 50%, someone who uses AI to get 100% of the homework grade will earn a D (sometimes passing) if they can get at least a 20% on your quizzes, and a C (always passing) if they get at least a 40%. Did you make your exam so difficult that students who truly didn't learn the material earn less than 20-40%? Because if it was, say, multiple choice questions with four possible answers, then you can expect them to earn at least 25% just by chance.
recursivedoubts 3 hours ago||
My quizzes are written responses, psuedocode and annotating code.
blharr 1 hour ago||
While that answers their direct question, they do bring up a good point -- how often are you handing out less than 25% scores on exams? Id imagine any professor to do that to get some severe criticism that would make even a cheater pretty livid
api 3 hours ago||
The last point is very interesting and might keep universities relevant.
paulorlando 42 minutes ago||
I like this. Related, this semester I've been using handwritten quizzes in class. A simple change that's been one of the best things as it changed students' expectations of class prep. Kind of do the readings and sort of prep and you can coast in class. But if you need to write out quiz answers you're forced to know the material better as well as maintain the ability to express yourself.

I also use low-point bonus questions to test general knowledge (huge variation on subjects I thought everyone knew).

binarycrusader 27 minutes ago|
I’ve been typing for years since the 80s. However, even in the 90s I found any extended period of handwriting to be painful and laborious. I don’t think I could handle an instructor that insisted on handwritten long form but I’d happily accept a compromise in the form of a typewriter.
paulorlando 22 minutes ago||
Sorry to say you can't take my class.
randoments 1 hour ago||
Reading all these comments, I feel like US universities are a joke.

I had to do all the exams in person. 100% of the grade was decided at the exam. Millions of people graduated this way and they are fine. No students were harmed in the process.

meroes 57 minutes ago||
No projects, no labs, no teamwork, no papers?

What a narrow set of skills to send into your economy.

ivankelly 51 minutes ago||
Given the way things are going, not knowing how to use AI will be like coming out not knowing about revision control
maplethorpe 49 minutes ago|||
Isn't the selling point of AI that it does it for you? What's to learn?
Levitz 25 minutes ago|||
"It does X for you" is the point of many technologies. You still require knowledge to work around it.

Context helps immensely, for example. Think of what you can do that someone outside tech can't.

strogonoff 10 minutes ago|||
The “it does X for you” aspect of technology is not completely without its downsides, for various values of X.

For example, take “X” to be “walking”. Do we have the technology that allows us to pretty much never have to walk? Sure. As far as I am aware, though, we do not generally favour a lifestyle of being bound to a mobility aid by choice, and in fact we have found that not walking when able in the long run creates substantial well-being issues for a human. (Now, we have found ways to alleviate some of those issues for those who aren’t able, but clearly it is not sufficient because we still walk.)

The problem is exacerbated immensely as the value of X approaches something as fundamental to one’s humanity as “thinking”.

Moonye666 4 minutes ago|||
[dead]
lacy_tinpot 27 minutes ago|||
If the AI does it for you, you need to still learn what to do.

What is the "it" that AI does for you?

This is assuming you know how to get good work out of AI in the first place. But even that is turning out to be a skill in and of itself.

mekael 45 minutes ago|||
I think you’re missing the /s.
doug_durham 38 minutes ago|||
So you didn't have to do any course work? No collaboration? No labs? I'm not aware of any University that doesn't have coursework outside of online diploma mills.
theFco 28 minutes ago||
In my undergrad, coursework did not count towards the grade for the module. But you earned the right to sit for the final exam by passing the courswork.
tyrust 1 hour ago||
Did you never have to write a research paper?
lizknope 1 hour ago||
My school couldn't afford typewriters in the 1980's and early 1990's.

We wrote assignments by hand using a pencil or pen.

Is that really complicated?

When I got to college and everything had to be typed I still wrote everything by hand on paper and edited with an eraser and a red pen to reorganize some sentences or paragraphs. Then I would go to the computer lab and type it in and print it out.

Swizec 4 hours ago|
When I was in college, your grade fully depended on the oral exam/debate with the professor. Everything else was but the entry ticket.

Not sure anyone even attempted to cheat in that scenario. And the conversations were usually great, although very stressful for us cramming types

mjlee 4 hours ago|
This sounds extremely susceptible to unconscious bias, or even just straightforward discrimination.
Swizec 2 hours ago|||
It does! That’s why you can ask to be evaluated by a commission of professors.

If you don’t pass after 3 tries, commission is mandatory.

You also have a paper trail of written exams and midterms to back you up. If you keep getting good grades and failing the oral, people will find that obviously suspicious.

Honestly the only times I had any trouble in the orals were the exams where I baaaaarely passed the written. Usually oral feels like the chill easy part compared to written because you can have a back-n-forth with the professor.

Terr_ 47 minutes ago||
> It does! That’s why you can ask to be evaluated by a commission of professors.

Still concerning from a statistical/psych fairness aspect.

There's a famous example of the Boston Symphony trying to fairly judge unseen applicants in 1952, and their results kept getting gender-skewed until they adjusted for the fact judges were reacting to the sound of shoes (e.g. high heels) when the candidate moved around behind the divider.

jubilanti 2 hours ago|||
Moreso than a job interview?
gpm 1 hour ago||
More systematic than a job interview.

If you don't get one job you should have - there are others - it's unfortunate but not life altering.

If 3 years into your marine biology program a professor who always teaches a mandatory course fails you because you're a woman who wears non traditional dress - you're not graduating and now there are no jobs. (And this is an example that actually happened to someone I know - not in a western country)

More comments...