Thursday, January 3, 2013

Receipts and the Mechanical Turk

Last time I discussed how using a QR code to categorize receipts would make data entry easier. Unfortunately this solution requires the cooperation of the stores. While easily doable it is hard to get the momentum going to add such a feature. Another thought I had at the same time was using Amazon's Mechanical Turk to do a similar process. I have actually implemented a simple version of this and run a few examples through the production Turk. I think people will find this very interesting both for the specific problem and for a good, yet still fairly simple example of using MTurk (as Amazon likes to call it). See https://www.mturk.com/mturk/welcome for the official Amazon site.

First, for those not familiar, MTurk is a platform that allows the creation of small tasks that are meant to be done by real people in exchange for a small fee, typically a few cents. Examples tend to include "identify the color of the automobile in a picture" or "determine the hours of operation at a particular business". These are trivially easy for a person to accomplish but not for a computer.

My idea is to take a picture of a receipt and extract information from it such as the date of purchase, the name of the business, and the category of spending. Now some of you out there are probably image processing experts and might try to do a full computerized solution to this problem, but I think most people will admit that although you can convert the image to text trying to parse out information like the date of purchase is really hard. Go ahead and take a look at a few receipts and see what you think, I'll wait...

So the idea is to submit the image to MTurk and let a human do the job in a few seconds. I found this a very interesting experiment both from the software and human perspective. It is true that MTurk costs real money but I spent less than $5.00 on my experiments and you can spend nothing to use and develop for it, it only costs money when real people start actually working for you.

To keep this from being an enormous blog post I am going to split this up over several posts and include implementation details later. I will end here with a screen shot of what the person saw when they processed my receipt using MTurk. Keep in mind we are still at an experimental stage and more information would be added in the future.



13 comments:

  1. The Australian powers has put aside a spending plan adding up to $4 billion to execute its Power Efficient Houses Package and among which is the Residence Insulation Plan.weblink

    ReplyDelete
  2. I have been intelligent for hours and I haven't gone through such awesome stuff. staqoo.com

    ReplyDelete
  3. Me and my companions have completely delighted in this blog.
    software development company in delhi

    ReplyDelete
  4. This is because peerless faucets have been part of the American home for many decades. Peerless brand faucets are manufactured by the delta media playercompany which, in turn, is owned by the Masco Corporation, a major player in the bath and kitchen industry.

    ReplyDelete
  5. The mortgage industry has been lobbying that loan modifications don't work. They regularly say that while modifications may temporarily postpone a foreclosure, the majority of people will fall behind on their payments and face foreclosure again. Yet the Mortgage Metrics report for the second quarter of 2009 implies something different. Charts in that report don't support that claim. They show that almost 60% of the people facing foreclosure whose loans are in the portfolios of the mortgage companies and thrifts have been able to stay current on their modified mortgages twelve months after they have been modified. buymodafinilonline.reviews

    ReplyDelete
  6. I wanted to thank you a lot more for this amazing web-site you have created here. It truly is full of useful tips for those who are genuinely interested in this subject, specifically this very post. Your all actually sweet plus thoughtful of others as well as reading your site posts is a wonderful delight in my experience. And what a generous reward! Mary and I will certainly have fun making use of your guidelines in what we must do in a few weeks. Our checklist is a mile long which means that your tips might be put to great use. maxon cinema 4d cost

    ReplyDelete
  7. Incredibly best man toasts, nicely toasts. is directed building your own by way of the wedding celebration as a result are supposed to try to be witty, amusing and consequently unusual as well as. best mans speech facetune app free download

    ReplyDelete
  8. Heya i’m for the first time here. I found this board and I to find It truly helpful & it helped me out a lot. I hope to provide something back and aid others such as you helped me. instagram likes free

    ReplyDelete
  9. The when I just read a blog, I’m hoping that this doesnt disappoint me approximately this one. Get real, Yes, it was my method to read, but When i thought youd have something interesting to state. All I hear is a number of whining about something that you could fix should you werent too busy trying to find attention. kinemaster pro free download

    ReplyDelete
  10. Some really superb info , Sword lily I found this. cotomovies download

    ReplyDelete
  11. When do you think this Real Estate market will go back in a positive direction? Or is it still too early to tell? We are seeing a lot of housing foreclosures in Altamonte Springs Florida. What about you? Would love to get your feedback on this. Dead Target unlimited gold

    ReplyDelete

Note: Only a member of this blog may post a comment.