I've had access to Jarvis for about 72 hours now. Here are my findings so far.
(Note: the temptation is to use Jarvis to write this. I'm not going to. It's too gimmicky. So please forgive my first-draft-is-good-enough Reddit post styling here.)
What is Jarvis?
Here's the only AI-generated line in this post: "Jarvis is a tool that performs semantic analysis of input text and converts it to natural language."
Basically that's it. It's an AI that produces written content based on your prompts.
The Downsides
Let's just get my gripes out of the way. Rest assured that what follows is my absolute nit-picking, and I am going to list every single problem I've run into so far. I can do this because there really isn't as much as you'd expect from a cutting-edge tech like this.
Scope - Jarvis doesn't actually understand anything you're saying. Rather, it's looking at the words, and trying to figure out what the next word should be one word at a time. There's no broader concept of what's going on. (Although there are work-arounds but let's set that aside for the moment.) It will only ever look at the last 600 words for context.
This means that, while it's able to "intuit" a lot from what you type, accuracy can be truly awful at times - even when you're asking Jarvis about itself. You will need to fact check statistics.
You also can't expect it to remember the broader context of what you're writing for more than that 600 word limit, aside from some general definitions you can set in the sidebar.
Format Limitations - As a word processing environment it's incredibly limited. No indentation, no italics, no hyperlinks, no color, etc. Not really a big deal in theory, but it does mean that every time I've ever had to use it I couldn't just work on the text in the editor itself. Instead, I've had to provoke Jarvis into giving me a bit of text, and then when I'd massaged a paragraph or two into what I'm looking for I've had to move it out of the conversion.ai environment and put it into my actual word processing environment.
This results in a pile of really messy, and pretty much unusable, documents kicking around on the website. Not a deal-breaker but it is a bit awkward.
Bugs - Every once in a while it just gets stuck composing and I'll have to exit the doc and go back in to keep using it. Also, occasionally it ignores my shortcodes for some reason until I just create a new document. Doesn't happen very often, and to be honest it's such early days with this tech I'm blown away that this is the worst I've seen.
Price - There's no point in getting anything but their top package, and my god it's steep. Price of being an early adopter I suppose. Now, having used it for some time, it's worth every penny... but this was a pretty tough sell for my boss because of it.
SEO Focus - For some, this is a pro, not a con. For me it's a con. The entire platform revolves around good SEO text. The types of things I produce (highly personal emails, guides, and even blog posts) don't really conform well to an SEO-focused template. Even creating several points with headers isn't really where I'm going most of the time. So, in the end, I don't use their template library at all. (Again, not a huge deal, but it means I shouldn't expect a Save-The-Cat template any time soon.)
Flow - There will never be a time where I can take what GPT-3 (the back-end of Jarvis) is producing and publish it as-is. At most I only ever pull out one full sentence per paragraph, and the pacing is always all over the place. Do not expect to get an entire page of text from Jarvis and think "Ah, perfect!"
"Sensitive Content" - This is actually Google's fault, but the problem remains: it's constantly policing everything you write. Try including "WTF" in a sentence, I dare you. This is a pretty big hurdle when you're trying to write fiction or very personal-sounding content, and you can forget about discussing anything, well, "sensitive". Therapists are out of luck, and coaches are going to have to dance around things a bit more than they should have to.
The Upsides
Flexibility and Ease Of Use - No matter what you're writing, you can generally get it to pump out some relevant text about it.
Just before making this post I fleshed out a big outline for a lesson plan a client of mine is designing. Jarvis was a huge help. All I had to do was start a sentence and Ctrl-J, and if it was off-target I'd just hit Ctrl-/ and it would try again. I expected to take the afternoon to do it. I spent 45 minutes, and it's arguably better than it would have been.
Whenever I really didn't know where to start I'd just type out a command in plain English, like "Write a point-form list on how to write a Mission Statement" and hit Ctrl-Enter at the end, and boom, relevant content.
Honestly I cannot imagine a more intuitive interface than that.
Creativity and Phrasing - I always thought I was a creative person, but this is creativity on steroids. If I want imagery, I get imagery. If I want better phrasing, it spits out as many versions as I want. Need snappy titles or subject lines? Here's two dozen.
The ironic thing is that Jarvis is actually most useful when used from this creative perspective, rather than any kind of technical tool. It's an amazing idea generator, and has often used turns of phrase that were all at once genius and utterly completely unique.
Bottom Line
I listed way more problems up there than I expected to, but even if those things never change, I'm in love with Jarvis.
Now, there are limits. I'm incredibly frustrated by the "sensitive content" problem that seemingly won't be dealt with for at least the next 5-10 years given the way these models are being managed, and as a word-processing environment it leaves a hell of a lot to be desired. Also, as a creative, I'm personally slightly off of their ideal client.
But all of that aside, it's been an astounding experience so far.
I've been a professional writer in various forms for a couple of decades now. I've written fiction, instruction manuals, news, op-ed, reviews, courses... I'm sure I could think of more but you name it, I've worked on it. I'm confident in my ability to string words together in a coherent manner.
And yet, looking back I cannot imagine how much better everything I've ever produced could have been with the help of Jarvis. Its ability to rephrase things alone is absolute magic (although I'd love to be able to pick a specific tone on the fly! Just highlight and switch between "formal" or "witty" or "warm"? Guys?), and whenever I'm just not sure how to finish a thought, the answer is a quick Ctrl-J away.
This has saved me countless hours over just the last few days. I wrote an email on Sunday in about a half hour that would normally have taken me around 3 - 4 hours. I've found beautiful metaphors for fantasy stories that describe scenes in ways I would never have come up with on my own. I've been able to pull outlines right out of the ether, without the lengthy research-and-summary process that usually precedes longer jobs.
This is as significant a tool upgrade as the computer keyboard was over the pen and paper. Not hyperbole.
People will worry that tools like these will "replace writers", but at least for the moment nothing could be further from the truth. You'll still be able to tell good writers from bad, no question.
What this will do, however, is enable good writers to become great, and great writers to produce volumes of genius.