John Gruber remarked on the lack of a clipboard on the iPhone and I found myself missing that feature this afternoon. Steven Johnson suggested a double-click of the Home button as a shortcut to the phone favorites screen to shorten initiation times for frequent calls. Both of these observations beg the question: how are new capabilities going to get added to the iPhone? A bunch of you are either interaction/interface designers or otherwise clever folks...how would you add a feature like a clipboard to the iPhone?
Here's where interaction on the iPhone stands right now. Pressing, holding, flipping physical buttons (home, power, silent, volume). Tapping buttons on the screen to active them. Tapping the screen to zoom in/out. Tap the screen with two fingers to zoom with Google Maps. Pinch and expand on screen to zoom in/out. Swipe screen to scroll up/down and side to side. Swipe screen to flip album covers in iPod mode. Touch and hold screen to bring up magnifying loupe and drag to move cursor. Flip unit to reorient screen from portrait to landscape and vice versa. Swipe message to delete. Swipe screen to unlock. There are probably more that I'm forgetting.
How do you add to that while keeping the interface intuitive, uncluttered (both the physical device and onscreen), and usable? Add a button to the device? Add buttons onscreen...a menu button perhaps? Double and triple pressing of physical buttons? New touchscreen gestures? Physical gestures like shaking the entire phone to left or right? Voice activated features? A combination of some/all of those?
A two finger press-and-hold on a text field (two fingers right next to each other, like the beginning of a pinch zoom in gesture) should bring up the magnify loupe, dragging (with one or both fingers, once the loupe has appeared) should select text, and upon release a context menu should appear with Cut, Copy, Paste, Delete.
A two finger press-and-hold released without selecting any text should bring up another context menu for Paste and Select All.
After the text is selected, you "grab" it by holding your finger on the selected text, and a bottom menue comes up where you can drag the text onto and drop them on the different functions "copy" and "cut" and "delete".
To paste, when your in a text field, you just double click in the text field and it pastes the thats in the clipboard. Simple as that.
Selecting arbitrary text is trickier: perhaps tap and hold to bring up the magnifier as works right now; then engage a second finger to indicate you've started selecting. Drag until you've got all the text and release the second finger to finish.
After the operation is complete, tap-and-hold should pop up a context menu for clipboard functions in both cases -- just like context menus used to work when Apple was all hot for one-button mice.
I'm not sure if a full clipboard is really that necessary, but I suppose it could be implemented simply as an active corner to fling things at. A side-scrolling panel could appear at the bottom listing each of the possible destinations to tap.
I actually think keeping the number of apps to a minimum is a good idea, and repurposing the mail client for as many actions as possible is better than, say, adding a completely separate Yojimbo-esque app.
All that said, I neither own nor have seen an iPhone in the wild. Yet. *grumble*
Also, a double-figure tap could bring up a "ribbon"-like menu consisting of, among other textual tools, a highlighter. Once the highlighter is selected, a tap-and-drag would highlight instead of move the I-beam and show the loupe.
For more finicky things like cut/copy/paste I think it comes down to being more aware of context. For highlighting text, drag two fingers over the area you want selected—this has been suggested a few times elsewhere; but then instead of just leaving it or being intrusive and asking what the person wants to do, the highlighted text is automatically copied to the clipboard. I mean, what else is the user going to do with it? No one is going to be writing a book on the iPhone, so moving blocks of text around isn't really necessary.
To paste, move the cursor to the desired location with the magnifying glass, the press down with another finger (so you start with one finger on the phone, and end with two). I feel like that's pretty intuitive.
Two-finger tap, hold down, then drag (with the magnifier) is the best idea I've seen for allowing for text selection ranges.
Spread your fingers to cover the text, either at each end of the line/segment then pinch them together. Everything in the range is selected into the clipboard
tap to cut
tap to paste
Perhaps tap to copy, and double tap to cut
And as people have mentioned, the magnifier looks like it could have many uses.
http://www.apple.com/macosx/features/inkwell/
and it's suite of gestures are available?
Put another, smaller circle at "2 o'clock" with a small scissors icon in it.
The user targets the starting point with the loupe, then clicks the scissors.
If you imagine using your right index finger to move the loupe, your middle finger would be the one to enact the scissors icon. Click once to start and once to stop the selection.
Then target the field for pasting, and the scissors becomes a stamp or something.
You could make the position of the action icon (11 o'clock or 2 o'clock) configurable to assuage the tender sensibilities of lefties.
From there just have buttons appear along the top of the screen (or maybe just above the selected text) for copy and delete and a paste button appear when you place the cursor somewhere else. Dead simple.
2) Hold down "Home" button while dragging magnifier to select words, sentences, etc.
3) Lifting finger freezes the selected area and pops up ribbon across bottom of screen with cut/copy/paste options.
Ribbon remains in view even so you may select another point in the text, highlight other text to replace or switch to another app to initiate paste.
"Clipboard" content remain active until you dismiss ribbon with tap on "Done" button, though the ribbon may minimize itself, or hide after a set period.
Double tap, and hold down the second tap. Drag your finger over the text to be copied, then lift your finger. Now, drag the selected text to the edge of the screen, where it "sticks".
Navigate to where you want to drop the text, and drag it from the edge of the screen where it was stuck to drop it where you want it.
For paste, I think there should be a target scissors circle attached to the magnifier (above and to the right, reversable for the left handed) to activate cut as normal, but then when pasteable content is present an additional attached circle appears below that you can press to paste the text.
It has to be something initiated while the magnifier is active, because if you indicate before then you want to paste it would be hard to select the proper starting point.
Also after cutting, if you start typing while text is selected, it should replace the selected area.
1 - Press & Hold the Phone button (assuming it's visible) which would invoke a popup menu similar to what happens when a Stack is clicked in Leopard.
2 - The popup menu would contain your favorites (assigned in Address Book). It could also be complete with thumbnail photos from AB.
3 - Select the desired number and BOOM!
As for the Cut/Copy/Paste dilemma, why not have something similar to a contextual menu? Assuming the clipboard concept exists in the iPhone version of OS X, the following is a fairly obvious solution in my mind:
1 - Select text by tapping (to place the insertion point at the beginning of the desired text block) and dragging to the end.
2 - Tap & Hold on the selected text invoking a contextual menu containing Cut, Copy and Paste commands (Paste would only be available if something is currently on the clipboard)
3 - Select the desired command.
4 - Pick a new insertion point by tapping.
5 - Tap & Hold, invoking the contextual menu.
6 - Choose Paste command.
Note: 5 & 6 could potentially be replaced with a double-tap.
For quick calls, perhaps some region of the top bar could bring you directly to your favorites list - currently while web browsing that brings you to the top of a web page, and I would hate to loose that. So perhaps clicking on the phone signal strength would be the key to bringing up the favorites.
Fairly, dude, this discussion is for our own amusement, not because we think we're better than Apple.
If you release the Home button now a copy of the word flies to the nearest screen edge, implying that this is a copy.
If you select a second word before releasing the Home button, everything between the two words is selected, and does the same fly to the edge trick, unless the text is not read-only, in which case a dialog pops up asking whether to copy or cut.
If the destination is read only then dragging the copied text onto it causes a "poof" and spring back to the edge; dragging into an editible field causes the magnifier to appear to insert the text.
To discard the clipping without pasting it -- either tap and hold for a dialog, or flick it wawy from the edge.
Overloading home is a terrible idea. If you haven't already noticed, the home button, while prominent, is placed out of the way. The last thing users want is to accidentally hit it in the middle of something. That placement makes many uses described above (hold down the home button to invoke a trails pseudo-mode?) awkward at best.
Apparently people want faster access to favorites. Seems to me that selecting the phone app should take you to your favorites (what else is the point?). If the person you want isn't on that screen, you press one more button. That shouldn't be too much trouble for someone you don't call all that often (else they'd be in your favorites).
In small fields like an address bar, the double tapping to get one word and triple tapping to select the whole bar is entirely appropriate.
When zoomed in on a page, similar double tapping for a word, triple tapping for a paragraph like in Safari would be nice.
For selecting words in a webpage to copy, etc:
Bring up the current cursor zoom bubble. Once you find the part of the text you want to select, tap the screen with a second finger. This invokes selecting. When you're done selecting text, stop dragging. The iPhone will notice a pause of predetermined length and stop the selection process.
Whenever text is selected, the iPhone will bring up one of its beautiful bubble-type menus with the options...
"Delete"
"Copy"
"Cut"
When you're typing in a text field, simply tapping with both fingers will bring up a similar bubble menu that says "Paste," but only when there is stuff in the clipboard.
Trails seems like an excellent idea, but I agree with Mr. Gruber. (In fact, I had the same problem in mind before I read his post.)
As for the phone feature, a home menu double tap is something I agree with.
But I think one of the larger points of Kottke's post was to explore even more options available for shortcuts. Any other ideas at all? I'm curious to see what you all come up with.
On quick Home access, perhaps there could be a target at the end of the unlock slider, with three zones to finish at - the default would be to resume the last thing you were looking at, but you could have a customized application page from the iPhone set as the top and bottom destinations (just above and below the slider), to veer off into at the last moment.
Related to this, does anyone know where a Feedback form for Apple might be? I'd like to report a few items and also make suggestions like these to Apple more directly - I'm waiting for the iPhone to appear here:
http://www.apple.com/feedback/
The Newton way. Hold the finger down a little while to start making a selection shape. With the selection, drag and drop it to the edge of the screen to place it 'on hold' for dropping it somewhere else (effectively a clipboard!). Switch apps, grab the proxy icon on the edge where you left it, and drop it in a text field.
a second placement of the magnifying glass at a point either before or after the first point, combined with another second finger tap would initiate the pop-up overlay allowing the selection of cut, copy, or clear.
switch environments by either switching apps or dropping a magnifier into a new point of insertion, then another second finger tap. this could trigger a pop-up with the last few selections added to the clipboard (with a few lines of preview each) and the final touch of the selected item in the clipboard would drop it where the insertion point was created.
voila. aren't we geniuses. this could also be used for images.
i'm sure this is alread implemented in prototype at Infinite Loop. Apple, in its wisdom, knows that we must learn to crawl before we learn to cut/copy/paste. Apple went to Montessori.
To select text: tap twice, holding down the second tap (this starts a "drag lock") and then move the finger along the text. Tap again to mark the end of the selection (this is a drag release).
To copy: tap the selected text with two fingers: a pop up menu comes with copy and an option (but not cut).
To paste: tap on the destination to set the cursor. Tap again with two fingers, the pop up menu comes again with paste.
This works if you have the following checked in the trackpad gestures preferences: [√] clicking [√] Dragging [√]Drag lock [√]Tap trackpad using two fingers for secondary click
It works nicely once you get used but it takes time to get used specially the drag lock - drag release stuff. I have seen people getting really confused when using my computer because they start selecting things unexpectedly. I think Apple will not implement something that will produce confusion in the casual usage. In the Mac this requires the above options to be selected, and they are off by default.
Or touching the display with your tongue!
I think extending from the current cursor metaphor (tap and hold opens loupe, starts cursor placement) is required, since you need that foundation to begin the action. In other words, double clicking to start selection or whatever other method is completely useless until you have your cursor at the starting point. Otherwise it would be like starting a selection with your eyes closed and hoping for the best.
1. use existing method to place "cursor"
2. tap a second finger anywhere
3. loupe toggles to become a selection loop
a. buttons appear on-screen for cut, copy, paste
b. cut/copy are dimmed until a selection made
c. paste dimmed unless something in buffer
(if buffer has content paste can be used immediately)
4. drag forward/backward to make selection
5. can release at this point and selection remains highlighted, buttons visible
6. touching selection turns cursor into drag 'n' drop loupe
7. cut, copy are un-dimmed and enabled, tapping performs action and returns to normal mode (no selection, buttons gone)
8. tap elsewhere to cancel selection
Somehow it all reminds me of the Etch-a-Sketch.
I don't like the idea of using the Home button for anything besides going Home. No need to over-complicate an intentionally simple function.
The iPhone will have two buttons roughly the same time Mac laptops get two buttons, i.e. the day after the NHL finals are played in Hades.
I think it would be easy to have one finger on the screen stationary and wipe over text with the other to select it. Then with the selecting finger on top of the selected text, swipe it to the side. So, no cut, but definitely copy and repeat the one stationary finger, swipe maneuver to paste.
I could see laptop and standard keyboards as gesture surfaces using the iPhones ui.
not tablet or touch screen, but a seperate 'gesture pad'
Once Apple gets any voice-dialing issues out of the way (dealing with spoken words NOT meant to activate phone features may be tricky, but probably not insurmountable... it only works when the phone is near your face, it does not work when you're on a call, or when iTunes is playing...), it goes on to other commands (cut, copy, paste, and commands for bringing up various functions... "notes" "calendar", etc.).
What I personally want is voice dictation. To hell with typing. Let me dictate my ideas on the fly. I'll edit them later.
Hey, Kirk got the computer to do all kinds of things via voice. People want the same relationship with the iPhone that Kirk and the gang had with their little pinned-on communications devices and tricorders.
How to Copy
------
Move the cursor into position via the loupe. Add a second finger and drag with both to the end of the selection (loupe still showing). Release both fingers. The selected text is copied to the clipboard; a small clipboard icon in the top status bar, just to the left of the battery. Successful copies are indicated by the copied item animating into the clipboard icon, using a "shrink" effect.
Selected text remains selected, and can be deleted using the backspace key in editable fields, or by typing over it. This eliminates the need for cut as a distinct option. Moving the cursor with the loupe tool deselects any selected text.
How to paste
------
If one or more things have been copied, a small clipboard icon appears in the top status bar, just to the left of the battery.
Touching that icon reveals a "clipboard" screen that looks similar to the email list. Each copied item is displayed in a list. The user simply taps an item to close the panel and paste the selected item at the current cursor position. Any items that are not eligible to be pasted are grayed out and disabled (i.e. copied photos that are not eligible for pasting into safari's url field or sms's text field, but are eligible for inclusion in a new email.)
The clipboard screen has two buttons, "clear" and "done". Clear removes all items from the clipboard (with confirmation), and Done closes the screen without pasting anything. Additionally, individual items in the clipboard are deletable via standard delete controls/gestures.
Just using a second finger to drag and select text seems better, but then I think you would be obscuring too much of the screen to easily select (I could see that perhaps not being too bad though).
I agree that Apple probably already has prototypes of everything we've been talking about, and will choose something for us eventually.
Use the loupe to place the cursor where you want to start selecting text. Click either a "Cut" "Copy" or "Paste" button on the virtual keyboard. Again, use the loupe to move the cursor. Cursor movement now selects text instead of just moving the cursor. Press "Cut" or "Paste" on the virtual keyboard again. In the case of "Cut" the selected text is removed and placed on the clipboard. In the case of "Copy" selected text is merely placed on the clipboard. Then use the loupe to place cursor where you want text to pasted and click "Paste". Obviously, this should work across applications. If these buttons won't fit on the keyboard make a contextual "Edit" keyboard much like the punctuation keyboard. No new gestures, no new buttons, no overloading current buttons. The only overloading is that the keyboard now becomes something to be used for command control and not just input.
Disclaimer: I don't own one of these things and only spent about 10 minutes with it in the store. So, I apologize if I am missing something.
Chris: There is no need for Cut as far as I see it, only Copy and Paste. A "cut" effect can be achieved by selecting text, hitting Copy, then hitting Backspace to remove the still-highlighted text. Hitting Backspace immediately after pasting could Undo the last action.
If there were a special mode where whatever spot was under your thumb was treated as the "5" spot, then a tap could serve for "5," orthogonal/diagonal slides (←↑→↓↖↗↘↙) would serve for the other digits 1-9, and perhaps a double-down (↓↓) would serve for 0. If you wanted to get really crazy, you'd then apply T9 to that for blind text entry.
Seems unlikely Apple will do this (although it could make for a useful adaptive technology). We'll have to wait until that SDK ships.
As for copy/paste, I'm going to go out on a limb and suggest something that many would consider heresy: an actual use for Notes.
There should be a “Save” button right next to the “Share” button. (Or there’s some way to make the Share button do this.) It saves the selected text as a new note. Later, the keyboard has a ”Notes” button that pastes the note into the field.
Now I don’t really think I’m going be copy/paisting that much, but I love command-shift-Y. (Or F8 when using Yojimbo) I suspect that there is so much out there that I would capture on my iPhone and later retrieve on my computer. That’s why I want a Save button.
There should be some modal tools located in the upper left corner of the screen that change the context of the finger input. These would include the 'pointer' tool (pointing finger icon), which is the default which behaves like the current iPhone interaction mode, an 'info' tool (lowercase 'i' icon), which would initiate a hover action on something you point to on the screen, and display any tooltips info on the selected interface element. If you click a second time on that element when in info mode, it returns to 'pointer' mode and initiates the standard click action. If you click on a different interface element, it will display the info for that. This will also provide a workaround for mouse-hover-dependent web site interfaces in Safari. The third modal button would be a 'text' or 'selection' tool (with the classic text selection cursor icon), which can select some text, image, or other element on the screen. With this tool active, the area you click on is the start of the text selection (in the case of text being clicked on), and the next points you point to or drag your finger to extend the text selection. In the case of an image or other element being selected, the first click selects the entire object you point to. If you click on the currently-selected text or object, it changes back to 'pointer' mode, and allows you to drag your selection to the edge of the screen. You can then change to whatever window or application you want to paste it to, and drag it back from the edge of the screen to where you want to paste it. You might allow application developers to make their own modal interaction buttons and parameters.
Selecting "Copy" causes the menu bar to expand the way it does when you use another application during a call, though perhaps blue instead of green; the second line says "Tap here to paste". Go to the other application, use the loupe to find the right location, and tap the expanded menu bar. Congratulations, you've just pasted. The menu bar shrinks. (You can't paste more than once without copying again--sorry.)
This does have issues with selections in horizontally scrolling environments, though, like Safari or Photos. Hmm...
To actually copy the text, flick it towards the button, where it goes into the clipboard, or do a double pinch again. (Note that the keyboard is always attached to some part of the button side of the screen.) Just as you enter symbol mode, you can get into paste mode from the keyboard. This shows a "text corral" of the last few snippets in complex object bubbles (like the ones that email addresses live inside on the To: line of an email). You can double click one to insert it at the cursor, or drag it with an insertion mark within the text you're currently composing. Hovering your finger over a snippet expands it (normally it would show "[start word ... ending]" ).
This system could be implemented on the iPhone easily.
I imagine that copy/cut/paste is one of the (too many :) things that got left on the shelf when the iPhone ship build went out the door a couple of months ago, and is also one of the reasons that Leopard developers got yanked to work on iPhone stuff (and some are probably _still_ working on for the most critical fixes for the first update, which I would make a wild-a$$ed-guess to be available around September, by the time the QA folks finish getting their meathooks on it, based on 30 years of third-party developing for Apple). I doubt whether copy/cut/paste will be in that first update if they haven't already written the code for it, though, unless there was a serious bug in existing code associated with this functionality in the beta (well, I suppose the first public release is always a beta, given that we will be getting multiple updates over time, right? :) and it had to get yanked. I would hope that copy/cut/paste is high on the list, though, and beats out stuff that the marketing types are always hot to trot out, despite the developers, and the general public, knowing full-well that the marketing-driven drivel generally doesn't add nearly as much value (if not downright reduce it) to the customer as core things like copy/cut/paste would.
If you're serious about providing feedback to Apple at a technical level (i.e., you can clearly and succinctly describe the problem and a reasonable, informed proposed solution - e.g., you've got actual GUI development experience on hand-held devices), you can post real bugs to https://bugreport.apple.com . However, you need to be registered with Apple Developer Connection (there is a free level that basically requires you to provide a valid e-mail address and other information to indicate your level of interest/expertise as an Apple software developer). There are over 5,311,382 bugs in the database across all Apple products, so you certainly won't be alone. BTW, that's around the number for my most recently-submitted bug on the iPhone concerning an annoying corner-case dialog that pops up every six minutes for certain AT&Dee-dee-dee accounts, but, provides no useful info, because all plans provide unlimited data access. It may actually be the fault in AT&Dee-dee-dee's billing system, and the iPhone is just dutifully doing what the AT&Dee-dee-dee "service" is telling it to do. When I pointed it out to AT&Dee-dee-dee, they, of course, immediately pointed the finger (I won't detail which one, since this is a family show :) at Apple, because "it's their software". Some things never change, heavy sigh.
All the Best,
Joe Blow
This thread is closed to new comments. Thanks to everyone who responded.

