xadisk
  1. xadisk
  2. XADISK-48

Write some tests for performance measurements.

    Details

    • Type: Task Task
    • Status: Reopened
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.0
    • Fix Version/s: current
    • Component/s: testcases
    • Labels:
      None
    • Environment:

      Operating System: All
      Platform: All

    • Issuezilla Id:
      48

      Description

      Thanks to Martijn van Tilburg for his query on performance metrics for XADisk.

      It encouraged me to start with some basic performance related tests - I started
      with a comparison between Java IO operations (which are transaction-less) and
      XADisk operations for read/write/truncate.

      What can be the most crucial thing for measurement? Some quick thoughts which
      came to me:

      a) It would be nice to see how the "average time taken" by a transaction would
      vary with the number of other concurrent transactions. This is because of shared
      resources like memory, cpu, and the huge bottleneck - the physical disk (with
      its head).

      b) Measurement of the time taken with number of concurrent transactions would
      make more sense if we are measuring data both from

      • XADisk (which provides ACID semantics)
      • Java IO API (which does NOT provide ACID semantics).

      It is well-known that the ACID transactional properties would always introduce
      an additional cost for the same operation done "natively (without a ACID
      transaction)".

      So, what would make more sense is to plot the measurements with XADisk and with
      Java IO API (for same operations) side-by-side.

      Have checked-in the new tests a few minutes ago.

      Thanks,
      Nitin

        Activity

        Hide
        Nitin Verma added a comment -

        Version should be "1.0" for consistency.

        Show
        Nitin Verma added a comment - Version should be "1.0" for consistency.
        Hide
        Nitin Verma added a comment -

        Have checked-in the tests to /trunk.

        Closing...

        Show
        Nitin Verma added a comment - Have checked-in the tests to /trunk. Closing...
        Hide
        Nitin Verma added a comment -

        I mistakenly closed this issue earlier. Reopening...

        It would be good to listen for feedback from community (and also research
        myself) on how to improve such tests (the current ones are quite basic) and what
        would be a proper setup to run the tests and also how things can be measured
        more precisely to get a broader picture of everything.

        Show
        Nitin Verma added a comment - I mistakenly closed this issue earlier. Reopening... It would be good to listen for feedback from community (and also research myself) on how to improve such tests (the current ones are quite basic) and what would be a proper setup to run the tests and also how things can be measured more precisely to get a broader picture of everything.

          People

          • Assignee:
            Nitin Verma
            Reporter:
            Nitin Verma
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated: