Welcome to the Java Programming Forums


The professional, friendly Java community. 21,500 members and growing!


The Java Programming Forums are a community of Java programmers from all around the World. Our members have a wide range of skills and they all have one thing in common: A passion to learn and code Java. We invite beginner Java programmers right through to Java professionals to post here and share your knowledge. Become a part of the community, help others, expand your knowledge of Java and enjoy talking with like minded people. Registration is quick and best of all free. We look forward to meeting you.


>> REGISTER NOW TO START POSTING


Members have full access to the forums. Advertisements are removed for registered users.

Results 1 to 1 of 1

Thread: Java Virtual Threads – Easy introduction

  1. #1
    Member
    Join Date
    Nov 2017
    Location
    USA
    Posts
    134
    Thanks
    6
    Thanked 1 Time in 1 Post

    Default Java Virtual Threads – Easy introduction



    Java virtual threads is a new feature introduced in JDK 19. It has potential to improve an applications availability, throughput and code quality on top of reducing memory consumption. This post intends to introduce java virtual threads in an easily understandable manner.

    Video: To see the visual walk-through of this post, click below:



    Thread Life Cycle


    Fig: Typical thread’s life cycle

    Let’s walkthrough a typical lifecycle of a thread:

    1. Thread is created in a thread pool

    2. Thread waits in the pool for a new request to come

    3. Once the new request comes, the thread picks up the request and it makes a backend Database call to service this request.

    4. Thread waits for response from the backend Database

    5. Once response comes back from the Database, the thread processes it, and sends back the response to customer

    6. Thread is returned back to the thread pool

    Step #2 to #6 will repeat until the application is shutdown.

    If you notice, the thread is actually doing real work only in step #3 and #5. In all other steps(i.e., step #1, step #2, step #4, step #6), it is basically waiting(or doing nothing). In most applications, a significant number of threads predominantly waits during most of its lifetime.

    Platform threads architecture


    Fig: Each Platform Thread is mapped to an Operating System Thread

    In the previous release of JVM(Java Virtual Machine), there was only one type of thread. It’s called as ‘classic’ or ‘platform’ thread. Whenever a platform thread is created, an operating system thread is allocated to it. Only when the platform thread exits(i.e., dies) the JVM, this operating system thread is free to do other tasks. Until then, it cannot do any other tasks. Basically, there is a 1:1 mapping between a platform thread and an operating system thread.

    According to this architecture, OS thread will be unnecessarily locked down in step #1, step #2, step #4, step #6 of the thread’s life cycle, even though it’s not doing anything during these steps. Since OS threads are precious and finite resources, it’s time is extensively wasted in this platform threads architecture.

    Virtual threads architecture



    Fig: OS Threads are not allocated to Platform threads until real work needs to be executed



    Fig: Virtual Threads are mapped to platform threads when it does real work

    In order to efficiently use underlying operating system threads, virtual threads have been introduced in JDK 19. In this new architecture, a virtual thread will be assigned to a platform thread (aka carrier thread) only when it executes real work. As per the above-described thread’s life cycle, only during step #3 and step #5 virtual thread will be assigned to the platform thread(which in turn uses OS thread) for execution. In all other steps, virtual thread will be residing as objects in the Java heap memory region just like any of your application objects. Thus, they are lightweight and more efficient.

    What is ‘stack chunk object’?

    When a virtual thread is not executing a real work and resides in a Java heap memory region, it is called as ‘stack chunk object’.

    How to create virtual threads?
    All the APIs that work with current platform threads, will work with virtual threads as is. However, the APIs to create java virtual threads are slightly different. Below is a sample program that creates Java virtual thread:

    1: 
     
    2: Runnable task = () -> { System.out.println("Hello Virtual Thread!"); };
     
    3:
     
    4: Thread.startVirtualThread(task);

    In this sample program, the virtual thread is created using ‘Thread.startVirtualThread()‘ API. This is the easiest API to create Java virtual threads. If you notice, in the above program in line #4, we are invoking ‘Thread.startVirtualThread()’ method by passing a Runnable object as an argument, which is created in line #2.

    You can also create java virtual threads using the following APIs:

    1. Thread.ofVirtual().start(Runnable);

    2. Thread.ofVirtual().unstarted(Runnable);

    3. Executors.newVirtualThreadPerTaskExecutor();

    4. Executors.newThreadPerTaskExecutor(ThreadFactory);

    More details about these APIs can be found in this post.

    Advantages of Java virtual threads
    Because of it’s elegant architecture, virtual threads provides several advantages:

    1. Improves application availability

    2. Improves application throughput

    3. Reduces ‘OutOfMemoryError: unable to create new native thread’

    4. Reduces application memory consumption

    5. Improves code quality

    6. 100% compatible with Platform Threads

    To learn more about these advantages in detail, you may read this post.

    What is the performance impact of virtual threads?
    Java virtual threads are much more lightweight than platform threads. To learn more about java virtual threads performance impact, you may refer to studies done here. However, in a nutshell:

    If your application either have lot of threads or large stack size (i.e. -Xss), then switching to virtual threads would reduce your application’s memory consumption.
    If your application is creating new threads frequently (instead of leveraging thread pool), switching to virtual threads can improve your application’s response time.

    Conclusion
    We hope this post helped to gain better understanding about java virtual threads – a wonderful addition to our phenomenal Java programming language.
    Last edited by Ram Lakshmanan; March 4th, 2023 at 12:47 AM. Reason: SOME CORRECTIONS

Similar Threads

  1. Virtual Keyboard in Java - Variable value enhancement button
    By torak80 in forum Java Theory & Questions
    Replies: 4
    Last Post: January 20th, 2018, 03:05 PM
  2. Could not create the Java virtual machine - RAD in Windows 7
    By DemeCarv in forum What's Wrong With My Code?
    Replies: 0
    Last Post: May 21st, 2014, 09:56 AM
  3. Replies: 2
    Last Post: May 2nd, 2013, 03:35 AM
  4. Java error "could not create java virtual machine"
    By aubrey4444 in forum Java Theory & Questions
    Replies: 17
    Last Post: October 3rd, 2010, 12:51 PM
  5. Virtual Keyboard in Java
    By Brian in forum Java Theory & Questions
    Replies: 2
    Last Post: June 2nd, 2010, 11:35 PM