Welcome to the Java Programming Forums


The professional, friendly Java community. 21,500 members and growing!


The Java Programming Forums are a community of Java programmers from all around the World. Our members have a wide range of skills and they all have one thing in common: A passion to learn and code Java. We invite beginner Java programmers right through to Java professionals to post here and share your knowledge. Become a part of the community, help others, expand your knowledge of Java and enjoy talking with like minded people. Registration is quick and best of all free. We look forward to meeting you.


>> REGISTER NOW TO START POSTING


Members have full access to the forums. Advertisements are removed for registered users.

Results 1 to 6 of 6

Thread: applications of machine learning / data mining

  1. #1
    Junior Member
    Join Date
    Oct 2012
    Posts
    3
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Cool applications of machine learning / data mining

    What are some areas of application of machine learning and data mining algorithms, which is directly used to generate revenue for the business?

    For example, I know that a lot of data companies simply see machine learning and data mining scientists as must-haves, even though their role is not a major contribution of wealth to the business.

    However, are there types of business which directly use machine learning to generate revenue? Or maybe other statistical algorithms.

    As another example, a lot of banks employ quants for regulatory purposes, but those roles are simply used to please regulators. In other words, most of the bank's direct revenue comes from other departments, from traders in front office, etc. But most quants work support roles, which are not even directly relevant to the business itself.


  2. #2
    Administrator copeg's Avatar
    Join Date
    Oct 2009
    Location
    US
    Posts
    5,320
    Thanks
    181
    Thanked 833 Times in 772 Posts
    Blog Entries
    5

    Default Re: applications of machine learning / data mining

    What are some areas of application of machine learning and data mining algorithms, which is directly used to generate revenue for the business?
    How google ranks their results, how amazon creates recommendations, how facebook grows their network, how some use advertising (and where they may choose to place it based upon their mining results) are all examples - these are all core technologies of these companies and while each is different, each leads to sales in one form or another (direct sales of products, advertising, etc...). Another example: in the biomedical industry data mining can be used to identify biomarkers - markers which can be used to diagnose and study diseases, which in turn leads to products (eg sales) in the form or kits for diagnosis, drugs for treatment, or even better: cures.
    Last edited by copeg; October 31st, 2012 at 09:48 AM.

  3. #3
    Junior Member
    Join Date
    Oct 2012
    Posts
    3
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default Re: applications of machine learning / data mining

    Quote Originally Posted by copeg View Post
    How google ranks their results, how amazon creates recommendations, how facebook grows their network, how some use advertising (and where they may choose to place it based upon their mining results) are all examples - these are all core technologies of these companies and while each is different, each leads to sales in one form or another (direct sales of products, advertising, etc...). Another example: in the biomedical industry data mining can be used to identify biomarkers - markers which can be used to diagnose and study diseases, which in turn leads to products (eg sales) in the form or kits for diagnosis, drugs for treatment, or even better: cures.
    I guess what I also want to know is how profitable are some of these jobs. For example, someone writing ML algos for stock market prediction is probably being paid a lot more than a bio data miner, because bio data miner is further from the money and the lion share of profits probably goes to the sales team.

    Are there many ML jobs which have a closer involvement to the financial aspect of things?

  4. #4
    Super Moderator helloworld922's Avatar
    Join Date
    Jun 2009
    Posts
    2,896
    Thanks
    23
    Thanked 619 Times in 561 Posts
    Blog Entries
    18

    Default Re: applications of machine learning / data mining

    I can tell you that the finance market highly recruits anyone with a strong mathematical background. Personally I find this annoying because I get a rather large quantity of email and physical mail asking me to pursue an MBA or some other finance degree, or get involved with some math/CS portion of a financial system, etc.

    I can't comment on how lucrative such positions are, but there must be a good financial incentive since the demand is fairly large. Somehow I kind of doubt you'd be paid significantly better than you would at a bio firm or a large corporation like Google or Amazon. These are all multi-billion/trillion dollar markets and companies understand the significance of being able to manage lots of data effectively.

  5. #5
    Administrator copeg's Avatar
    Join Date
    Oct 2009
    Location
    US
    Posts
    5,320
    Thanks
    181
    Thanked 833 Times in 772 Posts
    Blog Entries
    5

    Default Re: applications of machine learning / data mining

    Quote Originally Posted by prokyon View Post
    I guess what I also want to know is how profitable are some of these jobs. For example, someone writing ML algos for stock market prediction is probably being paid a lot more than a bio data miner, because bio data miner is further from the money and the lion share of profits probably goes to the sales team.

    Are there many ML jobs which have a closer involvement to the financial aspect of things?
    While I'm not in the finance sector professionally, my understanding is that in the data mining field the efficient-market hypothesis actually detours folks from data mining (the best example I've heard of is an example in which a neural network was training with the mood on Twitter, it was reported that the model could accurately predicted the Dow Jones (I believe the next day closing) - whether this could be used to make a profit is an different story, my guess is no). I'd agree with helloworld that math and statistical aspects of someone's experience would be valuable in this sector.

    Are there many ML jobs which have a closer involvement to the financial aspect of things?
    Are you talking specifically about the financial sector, or just the profit of a company, because I'd say the examples above are pretty closely tied to profit. Here's two more
    - Supermaket chains. Do an experiment, collect the data, and evaluate it using mining approaches for higher profits. For instance, in some stores place items lower on shelves, or move certain items further away from each other, color or place signs differently, place certain items on sale while others are not, customize coupons, whatever...the key is you have a lot of data of different conditions and the result from those changes (profit). You can mine this data to look for patterns and correlations that help increase profit.
    - Credit card companies - have to pay for fraudulent charges. They loose money when this happens, so its in their best interest to detect fraud as early as possible. Thus, they data mine cardholder's purchases, categorize the purchases as legitimate or fraud, which helps then detect fraud extremely quickly (with less monetary loss == higher profit)

  6. #6
    Junior Member
    Join Date
    Oct 2012
    Posts
    3
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default Re: applications of machine learning / data mining

    I'm actually working as a quant for a major bank, where I get to build statistical models for market risk. And I'd like to switch away from finance. I went into more details here, as to why:
    Nuclear Phynance

    In theory, data mining and machine learning type jobs are supposed to be paying a lot of money, but in reality that's only if you end up working for a top company, where the hiring process is fairly stringent.

    I'm convinced that I want to switch away from finance and more into machine learning / IT type of a role, but I'm not sure how to make the swithch at this stage. As posted on Nuclear Phynance, I'm pretty much sold at switching to IT, but the question is how do I get into more ML-type roles. I have pretty basic ML background. I can review C++, data structures, statistics and ML (hidden Markov models, mixture of Gaussians, logistic regression, Monte Carlo methods (rich background in MC methods), Naive Bayes).

    From what I've seen so far though, most ML positions already require knowledge of collaborative filtering, for example. Some roles already require Hadoop/MapReduce as well. Any ideas? I need to find more basic ML roles to start.

Similar Threads

  1. What is the best SDK for creating new Android applications?
    By p0oint in forum Android Development
    Replies: 7
    Last Post: May 2nd, 2013, 02:02 PM
  2. Writing java applications for the iPod Touch
    By JavaPF in forum Java ME (Mobile Edition)
    Replies: 8
    Last Post: June 14th, 2011, 04:34 PM
  3. applications in netbeans
    By Suni in forum Java IDEs
    Replies: 2
    Last Post: January 3rd, 2011, 02:25 PM
  4. Moving MySql Database from one machine to another machine
    By vaishali in forum JDBC & Databases
    Replies: 5
    Last Post: July 21st, 2010, 01:21 AM
  5. Applications of OOPs
    By sriraj.kundan in forum Object Oriented Programming
    Replies: 5
    Last Post: June 21st, 2009, 10:25 PM

Tags for this Thread