Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add max outstanding split size limit for thrift splits #168

Open
wants to merge 446 commits into
base: twitter-master
Choose a base branch
from
Open

Add max outstanding split size limit for thrift splits #168

wants to merge 446 commits into from
This pull request is big! We’re only showing the most recent 250 commits.

Commits on Dec 12, 2016

  1. Added more values for logging

    @Yaliang
    Yaliang committed Dec 12, 2016
    Configuration menu
    Copy the full SHA
    9c0e9f2 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2016

  1. Set Eviction Configs

    @Yaliang
    Yaliang committed Dec 13, 2016
    Configuration menu
    Copy the full SHA
    6123869 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2016

  1. Added support to pass transport pool config

    @Yaliang
    Yaliang committed Dec 14, 2016
    Configuration menu
    Copy the full SHA
    cdc7433 View commit details
    Browse the repository at this point in the history

  2. Update ZKMConfig test set

    @Yaliang
    Yaliang committed Dec 14, 2016
    Configuration menu
    Copy the full SHA
    604d9d2 View commit details
    Browse the repository at this point in the history

  3. Enforce thread safety

    @Yaliang
    Yaliang committed Dec 14, 2016
    Configuration menu
    Copy the full SHA
    602acb0 View commit details
    Browse the repository at this point in the history

  4. Remove default constructor

    @Yaliang
    Yaliang committed Dec 14, 2016
    Configuration menu
    Copy the full SHA
    518c27e View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2016

  1. Apply 100 ruler

    @Yaliang
    Yaliang committed Dec 15, 2016
    Configuration menu
    Copy the full SHA
    e2bc692 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2016

  1. Merge pull request twitter-forks#60 from Yaliang/yaliangw/addConnecti… 

    …onPool

add connection pool
    @Yaliang
    Yaliang authored Dec 16, 2016
    Configuration menu
    Copy the full SHA
    53e2d02 View commit details
    Browse the repository at this point in the history

  2. Update release version to 0.157-tw-0.29

    @Yaliang
    Yaliang committed Dec 16, 2016
    Configuration menu
    Copy the full SHA
    ae66897 View commit details
    Browse the repository at this point in the history

  3. Merge pull request twitter-forks#61 from Yaliang/yaliangw/updateRelea… 

    …seVersion

Update release version to 0.157-tw-0.29
    @Yaliang
    Yaliang authored Dec 16, 2016
    Configuration menu
    Copy the full SHA
    c1c4575 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2016

  1. invoke isReachable to test connection

    @Yaliang
    Yaliang committed Dec 20, 2016
    Configuration menu
    Copy the full SHA
    aba8854 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2017

  1. switch to 0.161 tag first

    Thomas Sun committed Jan 4, 2017
    Configuration menu
    Copy the full SHA
    b1c4854 View commit details
    Browse the repository at this point in the history

  2. resolve merge conflict to 0.161

    Thomas Sun committed Jan 4, 2017
    Configuration menu
    Copy the full SHA
    95819b7 View commit details
    Browse the repository at this point in the history

  3. revert back to old twitter tag

    Thomas Sun committed Jan 4, 2017
    Configuration menu
    Copy the full SHA
    dcb3a39 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2017

  1. correct revert version

    Thomas Sun committed Jan 5, 2017
    Configuration menu
    Copy the full SHA
    0b0da52 View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2017

  1. Merge pull request twitter-forks#63 from dabaitu/twitter-master 

    Upgrade to 0.161
    @dabaitu
    dabaitu authored Jan 6, 2017
    Configuration menu
    Copy the full SHA
    0cf760d View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#62 from Yaliang/yaliangw/connectionV… 

    …alidate

invoke isReachable to test connection
    @dabaitu
    dabaitu authored Jan 6, 2017
    Configuration menu
    Copy the full SHA
    76f4364 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2017

  1. upgrade version to 0.161-tw-0.29

    @Yaliang
    Yaliang committed Jan 12, 2017
    Configuration menu
    Copy the full SHA
    4362f3d View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#65 from Yaliang/yaliangw/upgradeVersion 

    upgrade version to 0.161-tw-0.29
    @dabaitu
    dabaitu authored Jan 12, 2017
    Configuration menu
    Copy the full SHA
    8d4e86a View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2017

  1. warn instead of fail when JVM is non-Oracle

    Thomas Sun committed Feb 1, 2017
    Configuration menu
    Copy the full SHA
    575f180 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#67 from dabaitu/switchJVM 

    warn instead of fail when JVM is non-Oracle
    @dabaitu
    dabaitu authored Feb 1, 2017
    Configuration menu
    Copy the full SHA
    5dd9eda View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2017

  1. Revert "Merge pull request twitter-forks#67 from dabaitu/switchJVM" 

    This reverts commit 5dd9eda, reversing
changes made to 8d4e86a.
    @Yaliang
    Yaliang committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    656f149 View commit details
    Browse the repository at this point in the history

  2. Revert "Merge pull request twitter-forks#65 from Yaliang/yaliangw/upg… 

    …radeVersion"

This reverts commit 8d4e86a, reversing
changes made to 76f4364.
    @Yaliang
    Yaliang committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    ebf8b53 View commit details
    Browse the repository at this point in the history

  3. Revert "Merge pull request twitter-forks#62 from Yaliang/yaliangw/con… 

    …nectionValidate"

This reverts commit 76f4364, reversing
changes made to 0cf760d.
    @Yaliang
    Yaliang committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    1bca487 View commit details
    Browse the repository at this point in the history

  4. Revert "Merge pull request twitter-forks#63 from dabaitu/twitter-master" 

    This reverts commit 0cf760d, reversing
changes made to c1c4575.
    @Yaliang
    Yaliang committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    79382a2 View commit details
    Browse the repository at this point in the history

  5. invoke isReachable to test connection

    @Yaliang
    Yaliang committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    2e28bcb View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2017

  1. warn instead of fail when JVM is non-Oracle

    @Yaliang
    Thomas Sun authored and Yaliang committed Feb 3, 2017
    Configuration menu
    Copy the full SHA
    3376122 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#69 from Yaliang/yaliangw/release-0.1… 

    …57-tw-0.30

Revert 0.161 upgrade, cherry pick 'yaliangw/connectonValidate' and 'dabaitu/switchJVM'
    @Yaliang
    Yaliang authored Feb 3, 2017
    Configuration menu
    Copy the full SHA
    ccaafc9 View commit details
    Browse the repository at this point in the history

  3. update version number 0.157-tw-0.30

    @Yaliang
    Yaliang committed Feb 3, 2017
    Configuration menu
    Copy the full SHA
    54e8b83 View commit details
    Browse the repository at this point in the history

  4. Merge pull request twitter-forks#70 from Yaliang/yaliangw/update-vers… 

    …ion-0.157-tw-0.30

update version 0.157-tw-0.30
    @Yaliang
    Yaliang authored Feb 3, 2017
    Configuration menu
    Copy the full SHA
    78662ca View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2017

  1. Merge tag 'tags/0.166' into yaliangw/twitter-master-upgrade-0.166 

    [maven-release-plugin]  copy for tag 0.166
    @Yaliang
    Yaliang committed Feb 24, 2017
    Configuration menu
    Copy the full SHA
    608cbad View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2017

  1. Merge pull request twitter-forks#73 from Yaliang/yaliangw/twitter-mas… 

    …ter-upgrade-0.166

twitter-master upgrade 0.166-tw-0.31
    @Yaliang
    Yaliang authored Mar 1, 2017
    Configuration menu
    Copy the full SHA
    af3b4b7 View commit details
    Browse the repository at this point in the history

  2. Release 0.166-tw-0.31

    @Yaliang
    Yaliang committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    be4517a View commit details
    Browse the repository at this point in the history

  3. Merge pull request twitter-forks#74 from Yaliang/yaliangw/release-0.1… 

    …66-tw-0.31

Release 0.166-tw-0.31
    @Yaliang
    Yaliang authored Mar 1, 2017
    Configuration menu
    Copy the full SHA
    9ede94b View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2017

  1. Initial commit to support LZO Thrift

    @Yaliang
    Yaliang committed Mar 14, 2017
    Configuration menu
    Copy the full SHA
    d526964 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2017

  1. Move classes into twitter folder with better namings

    @Yaliang
    Yaliang committed Mar 18, 2017
    Configuration menu
    Copy the full SHA
    9027039 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2017

  1. Set elephant-bird task config to avoid decode errors getting suppressed

    @Yaliang
    Yaliang committed Mar 20, 2017
    Configuration menu
    Copy the full SHA
    d071d79 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2017

  1. Enable splits for LZO Thrift data

    @dabaitu
    dabaitu committed Mar 21, 2017
    Configuration menu
    Copy the full SHA
    29a21ba View commit details
    Browse the repository at this point in the history

  2. Merge pull request #2 from dabaitu/thomass/enableSplitsForThrift 

    Enable splits for LZO Thrift data
    @Yaliang
    Yaliang authored Mar 21, 2017
    Configuration menu
    Copy the full SHA
    656cf3b View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2017

  1. Add support for thrif id mapping

    @Yaliang
    Yaliang committed Mar 22, 2017
    Configuration menu
    Copy the full SHA
    b9acafc View commit details
    Browse the repository at this point in the history

  2. Better Naming: ThriftGeneralRow -> ThriftGenericRow

    @Yaliang
    Yaliang committed Mar 22, 2017
    Configuration menu
    Copy the full SHA
    63fca50 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2017

  1. Support splittable lzo

    @Yaliang
    Yaliang committed Mar 24, 2017
    Configuration menu
    Copy the full SHA
    e90d854 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2017

  1. Remove tw version

    @Yaliang
    Yaliang committed Mar 28, 2017
    Configuration menu
    Copy the full SHA
    6c56bf6 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2017

  1. Merge tags/0.170 into twitter-master

    @Yaliang
    Yaliang committed Mar 29, 2017
    Configuration menu
    Copy the full SHA
    92f920f View commit details
    Browse the repository at this point in the history

  2. Release 0.170-tw-0.32

    @Yaliang
    Yaliang committed Mar 29, 2017
    Configuration menu
    Copy the full SHA
    7f4f700 View commit details
    Browse the repository at this point in the history

  3. Merge pull request twitter-forks#76 from Yaliang/yaliangw/release-0.1… 

    …70-tw-0.32

Release 0.170-tw-0.32
    @Yaliang
    Yaliang authored Mar 29, 2017
    Configuration menu
    Copy the full SHA
    34f2d26 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2017

  1. Rebase 0.170-tw-0.32

    @Yaliang
    Yaliang committed Mar 31, 2017
    Configuration menu
    Copy the full SHA
    d674783 View commit details
    Browse the repository at this point in the history

  2. Fix missed method

    @Yaliang
    Yaliang committed Mar 31, 2017
    Configuration menu
    Copy the full SHA
    433cb84 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2017

  1. Support skip unused top level column

    @Yaliang
    Yaliang committed Apr 1, 2017
    Configuration menu
    Copy the full SHA
    f07187c View commit details
    Browse the repository at this point in the history

  2. Fix a mistake in splitting

    @Yaliang
    Yaliang committed Apr 1, 2017
    Configuration menu
    Copy the full SHA
    00038dc View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2017

  1. add table and columns info to QueryCompletedEvents

    thomass committed Apr 10, 2017
    Configuration menu
    Copy the full SHA
    3a9676b View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#78 from dabaitu/thomass/add-table-co… 

    …lumns-info-exp

add table and columns info to QueryCompletedEvents
    @dabaitu
    dabaitu authored Apr 10, 2017
    Configuration menu
    Copy the full SHA
    420dd14 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2017

  1. Merge branch 'twitter-master' into yaliangw/addThriftInHive

    @Yaliang
    Yaliang committed Apr 11, 2017
    Configuration menu
    Copy the full SHA
    c643602 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2017

  1. Better toString for HiveThriftFieldIdResolver; Allow EB config been o… 

    …verride by table
    @Yaliang
    Yaliang committed Apr 13, 2017
    Configuration menu
    Copy the full SHA
    987c5a2 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2017

  1. Better Logging

    @Yaliang
    Yaliang committed Apr 14, 2017
    Configuration menu
    Copy the full SHA
    0a15a09 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2017

  1. Refactor thrift field id resolver

    @Yaliang
    Yaliang committed Apr 15, 2017
    Configuration menu
    Copy the full SHA
    09de625 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2017

  1. mave tag to 0.173 first

    thomass committed Apr 16, 2017
    Configuration menu
    Copy the full SHA
    6d4eaaf View commit details
    Browse the repository at this point in the history

  2. resolve conflicts

    thomass committed Apr 16, 2017
    Configuration menu
    Copy the full SHA
    b3ebd73 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2017

  1. Support deserialization when the SerDe is set as LazyBinarySerDe

    @Yaliang
    Yaliang committed Apr 17, 2017
    Configuration menu
    Copy the full SHA
    becae61 View commit details
    Browse the repository at this point in the history

  2. Move functions out of ThriftGeneralInputFormat

    @Yaliang
    Yaliang committed Apr 17, 2017
    Configuration menu
    Copy the full SHA
    cce5023 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2017

  1. move elephantbird config setting into cursor provider

    @Yaliang
    Yaliang committed Apr 18, 2017
    Configuration menu
    Copy the full SHA
    359479c View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2017

  1. Initial commit to support LZO Thrift write

    @Yaliang
    Yaliang committed Apr 20, 2017
    Configuration menu
    Copy the full SHA
    7bb2994 View commit details
    Browse the repository at this point in the history

  2. resolve dependency conflicts and revert version back to twitter version

    thomass committed Apr 20, 2017
    Configuration menu
    Copy the full SHA
    c526b86 View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2017

  1. exclude zookeeper from presto-hive instead of adding it with the same… 

    … version
    thomass committed Apr 21, 2017
    Configuration menu
    Copy the full SHA
    e6025e5 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2017

  1. use 3.5.1-alpha for zookeeper overall and 3.4.9 for kafka; use guava … 

    …21.0 in presto-tests to avoid clientcxn oom errors
    thomass committed Apr 25, 2017
    Configuration menu
    Copy the full SHA
    b914b61 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2017

  1. add support to split lzo file in createHiveSplitIterator directly

    @Yaliang
    Yaliang committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    49e673d View commit details
    Browse the repository at this point in the history

  2. add TODO comments to adapt better versions of packages to resolve dep… 

    … conflicts
    thomass committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    bde735a View commit details
    Browse the repository at this point in the history

  3. Merge pull request twitter-forks#79 from dabaitu/upgrade_to_173 

    Upgrade to 0.173
    @dabaitu
    dabaitu authored Apr 26, 2017
    Configuration menu
    Copy the full SHA
    e087e68 View commit details
    Browse the repository at this point in the history

  4. Make internal release tag 0.173-tw-0.33

    thomass committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    fc43cc4 View commit details
    Browse the repository at this point in the history

  5. Merge pull request twitter-forks#80 from dabaitu/tag_for_173_release 

    Make internal release tag 0.173-tw-0.33
    @dabaitu
    dabaitu authored Apr 26, 2017
    Configuration menu
    Copy the full SHA
    cbf6813 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2017

  1. Added unit test for pre-generated lzo thrift data

    @Yaliang
    Yaliang committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    d0d2ae3 View commit details
    Browse the repository at this point in the history

  2. Remove log in BackgroundHiveSplitLoader

    @Yaliang
    Yaliang committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    9b06ace View commit details
    Browse the repository at this point in the history

  3. change the writeField parameter in ThriftGenericRow

    @Yaliang
    Yaliang committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    0a648af View commit details
    Browse the repository at this point in the history

  4. Adapt method name lzo->lzop as oss patch

    @Yaliang
    Yaliang committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    85f3764 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2017

  1. Remove hard coded class name and Remove LZO codec in HiveCompressionC… 

    …odec
    @Yaliang
    Yaliang committed Apr 28, 2017
    Configuration menu
    Copy the full SHA
    87cf0c0 View commit details
    Browse the repository at this point in the history

  2. Remove tests on THRIFTBINARY format in AbstractTestHiveClient, TestHi… 

    …veIntegrationSmokeTest, TestHivePageSink
    @Yaliang
    Yaliang committed Apr 28, 2017
    Configuration menu
    Copy the full SHA
    21a2b5c View commit details
    Browse the repository at this point in the history

  3. Adapt to more compact json string

    @Yaliang
    Yaliang committed Apr 28, 2017
    Configuration menu
    Copy the full SHA
    6bc1de5 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2017

  1. Add tests for HiveThriftFieldIdResolver

    @Yaliang
    Yaliang committed Apr 29, 2017
    Configuration menu
    Copy the full SHA
    c3ddc7e View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2017

  1. Expose data transfer size as data flow between stages, calculated fro… 

    …m payload field in QueryMetadata
    thomass committed Apr 30, 2017
    Configuration menu
    Copy the full SHA
    829007c View commit details
    Browse the repository at this point in the history

  2. safe guard number parse error

    thomass committed Apr 30, 2017
    Configuration menu
    Copy the full SHA
    b91f46e View commit details
    Browse the repository at this point in the history

Commits on May 2, 2017

  1. Address Yaliang's comment which exposed a bug

    thomass committed May 2, 2017
    Configuration menu
    Copy the full SHA
    082884f View commit details
    Browse the repository at this point in the history

Commits on May 3, 2017

  1. Use PrestoException in ThriftGeneralInputFormat

    @Yaliang
    Yaliang committed May 3, 2017
    Configuration menu
    Copy the full SHA
    1b7addc View commit details
    Browse the repository at this point in the history

  2. Unsupport write in thrift generic row

    @Yaliang
    Yaliang committed May 3, 2017
    Configuration menu
    Copy the full SHA
    5541366 View commit details
    Browse the repository at this point in the history

  3. move getSerializationClassName to ThriftHiveRecordCursorProvider

    @Yaliang
    Yaliang committed May 3, 2017
    Configuration menu
    Copy the full SHA
    a8ac008 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2017

  1. Better naming for default thrift id resolver

    @Yaliang
    Yaliang committed May 4, 2017
    Configuration menu
    Copy the full SHA
    6df4e86 View commit details
    Browse the repository at this point in the history

  2. Added example of json property

    @Yaliang
    Yaliang committed May 4, 2017
    Configuration menu
    Copy the full SHA
    7d5685f View commit details
    Browse the repository at this point in the history

  3. Merge pull request twitter-forks#75 from Yaliang/yaliangw/addThriftIn… 

    …Hive

Add LZO Thrift read support in Presto-hive.
    @Yaliang
    Yaliang authored May 4, 2017
    Configuration menu
    Copy the full SHA
    71b47c6 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2017

  1. prepend schema name before table name to avoid confusion

    thomass committed May 8, 2017
    Configuration menu
    Copy the full SHA
    f2707ae View commit details
    Browse the repository at this point in the history

  2. expose granular info, include operator stats

    thomass committed May 8, 2017
    Configuration menu
    Copy the full SHA
    5f7515b View commit details
    Browse the repository at this point in the history

  3. remove unused imports

    thomass committed May 8, 2017
    Configuration menu
    Copy the full SHA
    d4e92c3 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2017

  1. Merge pull request twitter-forks#83 from dabaitu/add_schema_name 

    prepend schema name before table name to avoid confusion
    @dabaitu
    dabaitu authored May 9, 2017
    Configuration menu
    Copy the full SHA
    fc9a972 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2017

  1. Filter out nulls in collections

    thomass committed May 10, 2017
    Configuration menu
    Copy the full SHA
    3bb8516 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#82 from dabaitu/expose_data_transfer… 

    …_size

Expose data transfer size as data flow between stages
    @dabaitu
    dabaitu authored May 10, 2017
    Configuration menu
    Copy the full SHA
    ffb2685 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2017

  1. Release 0.173-tw-0.34

    @Yaliang
    Yaliang committed May 11, 2017
    Configuration menu
    Copy the full SHA
    3e4920b View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#84 from Yaliang/yaliangw/release-0.1… 

    …73-tw-0.34

Release 0.173-tw-0.34
    @Yaliang
    Yaliang authored May 11, 2017
    Configuration menu
    Copy the full SHA
    0152f9f View commit details
    Browse the repository at this point in the history

Commits on May 13, 2017

  1. Fix json dependency error, fix split error, move Json.createReader in… 

    …to try box
    @Yaliang
    Yaliang committed May 13, 2017
    Configuration menu
    Copy the full SHA
    40a7e8e View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#85 from Yaliang/yaliangw/correct-jso… 

    …n-dependency

Fix QueryStatsHelper
    @dabaitu
    dabaitu authored May 13, 2017
    Configuration menu
    Copy the full SHA
    db80602 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2017

  1. Add split path in the cursor error message

    @Yaliang
    Yaliang committed May 17, 2017
    Configuration menu
    Copy the full SHA
    27297fb View commit details
    Browse the repository at this point in the history

Commits on May 18, 2017

  1. Move to 0.176 version

    @Yaliang
    Yaliang committed May 18, 2017
    Configuration menu
    Copy the full SHA
    391dd19 View commit details
    Browse the repository at this point in the history

  2. Merge oss-0.176

    @Yaliang
    Yaliang committed May 18, 2017
    Configuration menu
    Copy the full SHA
    afe7440 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2017

  1. Fix conflict

    @Yaliang
    Yaliang committed May 21, 2017
    Configuration menu
    Copy the full SHA
    330f47f View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#86 from Yaliang/yaliangw/log-bad-spl… 

    …it-location

Add split path in the cursor error message
    @Yaliang
    Yaliang authored May 21, 2017
    Configuration menu
    Copy the full SHA
    bc471d4 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'twitter-master' into yaliangw/release-0.176-tw-0.35

    @Yaliang
    Yaliang committed May 21, 2017
    Configuration menu
    Copy the full SHA
    d14f259 View commit details
    Browse the repository at this point in the history

  4. Merge pull request twitter-forks#87 from Yaliang/yaliangw/release-0.1… 

    …76-tw-0.35

release 0.176-tw-0.35
    @Yaliang
    Yaliang authored May 21, 2017
    Configuration menu
    Copy the full SHA
    4c1d65d View commit details
    Browse the repository at this point in the history

Commits on May 24, 2017

  1. put the tmp path under the default schema's folder

    @Yaliang
    Yaliang committed May 24, 2017
    Configuration menu
    Copy the full SHA
    963a167 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2017

  1. Use forEach on stream to modify external collection; map doesn't work

    thomass committed Jun 5, 2017
    Configuration menu
    Copy the full SHA
    e34eec0 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#89 from dabaitu/thomass/fix-metrics 

    Use forEach on stream to modify external collection; map doesn't work
    @dabaitu
    dabaitu authored Jun 5, 2017
    Configuration menu
    Copy the full SHA
    88100c4 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2017

  1. use user's home

    @Yaliang
    Yaliang committed Jun 6, 2017
    Configuration menu
    Copy the full SHA
    a92181e View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#88 from Yaliang/yaliangw/ctas-work-a… 

    …round

Put the tmp path under a user's folder
    @Yaliang
    Yaliang authored Jun 6, 2017
    Configuration menu
    Copy the full SHA
    75ed21c View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2017

  1. reset the oss base version

    @Yaliang
    Yaliang committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    89493b4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'oss-0.179' into yaliangw/upgrade-0.179 

    # Conflicts:
#	pom.xml
#	presto-hive/src/main/java/com/facebook/presto/hive/HiveClientModule.java
    @Yaliang
    Yaliang committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    2b90e0e View commit details
    Browse the repository at this point in the history

  3. prepare release 0.179-tw-0.36

    @Yaliang
    Yaliang committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    20c2816 View commit details
    Browse the repository at this point in the history

  4. Fit new event

    @Yaliang
    Yaliang committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    a7f633f View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2017

  1. Fit temp path change for tests

    @Yaliang
    Yaliang committed Jun 20, 2017
    Configuration menu
    Copy the full SHA
    c517f40 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2017

  1. Merge pull request twitter-forks#90 from Yaliang/yaliangw/upgrade-0.179 

    upgrade Presto to 0.179
    @Yaliang
    Yaliang authored Jun 21, 2017
    Configuration menu
    Copy the full SHA
    f2a066d View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2017

  1. Set default value for hive statistic feature to false

    @Yaliang
    Yaliang committed Jun 26, 2017
    Configuration menu
    Copy the full SHA
    2f85330 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#92 from Yaliang/yaliangw/set-hive-st… 

    …at-off-in-default

Set default value for hive statistic feature to false
    @Yaliang
    Yaliang authored Jun 26, 2017
    Configuration menu
    Copy the full SHA
    d794e7c View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2017

  1. Thrift Decoder

    @xiaoyao1991
    xiaoyao1991 committed Jul 20, 2017
    Configuration menu
    Copy the full SHA
    77ded78 View commit details
    Browse the repository at this point in the history

  2. cleanup

    @xiaoyao1991
    xiaoyao1991 committed Jul 20, 2017
    Configuration menu
    Copy the full SHA
    d98b04e View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2017

  1. avoid unnecessary version conflict during merge

    thomass committed Jul 27, 2017
    Configuration menu
    Copy the full SHA
    d8a6e9e View commit details
    Browse the repository at this point in the history

  2. merged 0.181, resolved conflicts

    thomass committed Jul 27, 2017
    Configuration menu
    Copy the full SHA
    791d3d5 View commit details
    Browse the repository at this point in the history

  3. use twitter tag 0.181-tw-0.37, update ThriftHiveRecordCursorProvider … 

    …function signature
    thomass committed Jul 27, 2017
    Configuration menu
    Copy the full SHA
    c8a76bb View commit details
    Browse the repository at this point in the history

  4. Merge pull request twitter-forks#98 from dabaitu/upgrade_to_181 

    Upgrade to 181
    @dabaitu
    dabaitu authored Jul 27, 2017
    Configuration menu
    Copy the full SHA
    70baf50 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2017

  1. Merge pull request twitter-forks#95 from xiaoyao1991/thrift_decoder_fin 

    Thrift decoder
    @Yaliang
    Yaliang authored Jul 31, 2017
    Configuration menu
    Copy the full SHA
    92a9ebc View commit details
    Browse the repository at this point in the history

  2. clone presto-kafka as presto-kafka07 plugin

    @xiaoyao1991
    xiaoyao1991 committed Jul 31, 2017
    Configuration menu
    Copy the full SHA
    1936564 View commit details
    Browse the repository at this point in the history

  3. kafka07 changes

    @xiaoyao1991
    xiaoyao1991 committed Jul 31, 2017
    Configuration menu
    Copy the full SHA
    47ac252 View commit details
    Browse the repository at this point in the history

  4. address comments

    @xiaoyao1991
    xiaoyao1991 committed Jul 31, 2017
    Configuration menu
    Copy the full SHA
    a5f13ce View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2017

  1. Merge pull request twitter-forks#96 from xiaoyao1991/kafka07_plugin 

    Kafka07 plugin
    @Yaliang
    Yaliang authored Aug 8, 2017
    Configuration menu
    Copy the full SHA
    ab45afb View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2017

  1. Fix build and style

    @xiaoyao1991
    xiaoyao1991 committed Aug 9, 2017
    Configuration menu
    Copy the full SHA
    5feb582 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#99 from xiaoyao1991/fix_build 

    Fix build and style
    @Yaliang
    Yaliang authored Aug 9, 2017
    Configuration menu
    Copy the full SHA
    dadbfe0 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2017

  1. Tableau Presto ODBC Driver fix

    @Yaliang
    Yaliang committed Aug 10, 2017
    Configuration menu
    Copy the full SHA
    8725ff9 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2017

  1. Merge pull request twitter-forks#101 from Yaliang/yaliangw/tableau-dr… 

    …iver-node-version

Tableau Presto ODBC Driver fix
    @Yaliang
    Yaliang authored Aug 14, 2017
    Configuration menu
    Copy the full SHA
    266ec2c View commit details
    Browse the repository at this point in the history

  2. Fix test

    @Yaliang
    Yaliang committed Aug 14, 2017
    Configuration menu
    Copy the full SHA
    b7ae0e2 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2017

  1. Merge pull request twitter-forks#103 from Yaliang/yaliangw/npl-fix 

    NPE fix for test
    @Yaliang
    Yaliang authored Aug 15, 2017
    Configuration menu
    Copy the full SHA
    2ec5182 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2017

  1. version 0.181-tw-0.38

    @Yaliang
    Yaliang committed Aug 17, 2017
    Configuration menu
    Copy the full SHA
    e092c37 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#104 from Yaliang/yaliangw/0.181-TW-0.38 

    new release 0.181-tw-0.38
    @Yaliang
    Yaliang authored Aug 17, 2017
    Configuration menu
    Copy the full SHA
    4a277de View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2017

  1. Fix kafka07 unit test

    @Yaliang
    Yaliang committed Aug 21, 2017
    Configuration menu
    Copy the full SHA
    2f6c8c7 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#105 from Yaliang/yaliangw/unit-test-fix 

    Fix kafka07 unit test
    @Yaliang
    Yaliang authored Aug 21, 2017
    Configuration menu
    Copy the full SHA
    650eac4 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2017

  1. add cumulative memory and peak memeory

    thomass committed Aug 30, 2017
    Configuration menu
    Copy the full SHA
    1501e50 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#106 from dabaitu/thomass/chargeback/… 

    …add-cumulative-mem

add cumulative memory and peak memeory
    @Yaliang
    Yaliang authored Aug 30, 2017
    Configuration menu
    Copy the full SHA
    b426b80 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2017

  1. prepare release 0.181-tw-0.39

    thomass committed Aug 31, 2017
    Configuration menu
    Copy the full SHA
    70023d4 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#108 from dabaitu/new-metrics-release 

    prepare release 0.181-tw-0.39
    @Yaliang
    Yaliang authored Aug 31, 2017
    Configuration menu
    Copy the full SHA
    3251cd1 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2017

  1. add cpuTime_ms

    thomass committed Sep 25, 2017
    Configuration menu
    Copy the full SHA
    13d0032 View commit details
    Browse the repository at this point in the history

  2. update thrift package version

    thomass committed Sep 25, 2017
    Configuration menu
    Copy the full SHA
    b7a4ed1 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2017

  1. Added file path for error splitting blocks

    @Yaliang
    Yaliang committed Oct 2, 2017
    Configuration menu
    Copy the full SHA
    ad476ae View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2017

  1. Fix Travis CI for twitter-master branch. 

    Split twitter-modules into seperate profile
Add presto-twitter-server
Alter location formulation for the temp folder
Switch Travis badge in README
Setup twitter notification
Remove broken cli and hive connector related tests in presto-product-test
    @Yaliang
    Yaliang committed Oct 13, 2017
    Configuration menu
    Copy the full SHA
    07ade55 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#114 from Yaliang/yaliangw/fix-twitte… 

    …r-master-ci

Fix twitter master ci
    @Yaliang
    Yaliang authored Oct 13, 2017
    Configuration menu
    Copy the full SHA
    d26be9e View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2017

  1. Point the thrift id into NON_EXISTED_THRIFT_ID if the id resolver failed

    @Yaliang
    Yaliang committed Oct 17, 2017
    Configuration menu
    Copy the full SHA
    4d7c92c View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#112 from Yaliang/yaliangw/splittable… 

    …-lzo-over-length

Added file path for errors on splitting blocks
    @Yaliang
    Yaliang authored Oct 17, 2017
    Configuration menu
    Copy the full SHA
    8b0e19e View commit details
    Browse the repository at this point in the history

  3. Merge pull request twitter-forks#110 from dabaitu/addCpuTime 

    Add query cpu time for BigQuery comparison
    @Yaliang
    Yaliang authored Oct 17, 2017
    Configuration menu
    Copy the full SHA
    16b8aa6 View commit details
    Browse the repository at this point in the history

  4. Use default Java version for Travis CI

    @electrum @Yaliang
    electrum authored and Yaliang committed Oct 17, 2017
    Configuration menu
    Copy the full SHA
    74875d7 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2017

  1. Move back to oss version

    @Yaliang
    Yaliang committed Oct 18, 2017
    Configuration menu
    Copy the full SHA
    43588a8 View commit details
    Browse the repository at this point in the history

  2. upgrade to 0.186

    @Yaliang
    Yaliang committed Oct 18, 2017
    Configuration menu
    Copy the full SHA
    92da521 View commit details
    Browse the repository at this point in the history

  3. Adapt thrift reader

    @Yaliang
    Yaliang committed Oct 18, 2017
    Configuration menu
    Copy the full SHA
    ffa86a6 View commit details
    Browse the repository at this point in the history

  4. bump up version to 0.186-tw-0.40

    @Yaliang
    Yaliang committed Oct 18, 2017
    Configuration menu
    Copy the full SHA
    0ce96b4 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2017

  1. correct code style

    @Yaliang
    Yaliang committed Oct 19, 2017
    Configuration menu
    Copy the full SHA
    5572f0c View commit details
    Browse the repository at this point in the history

  2. downgrade curator-test version

    @Yaliang
    Yaliang committed Oct 19, 2017
    Configuration menu
    Copy the full SHA
    c92d55d View commit details
    Browse the repository at this point in the history

  3. Fix tests for BackgroundHiveSplitLoader

    @Yaliang
    Yaliang committed Oct 19, 2017
    Configuration menu
    Copy the full SHA
    e86c049 View commit details
    Browse the repository at this point in the history

  4. [maven-release-plugin] prepare release 0.187

    @nezihyigitbasi
    nezihyigitbasi committed Oct 19, 2017
    Configuration menu
    Copy the full SHA
    ba6c399 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2017

  1. Merge pull request twitter-forks#116 from Yaliang/yaliangw/upgrade-0.186 

    upgrade to 0.186-tw-0.40
    @Yaliang
    Yaliang authored Oct 20, 2017
    Configuration menu
    Copy the full SHA
    ff9edc2 View commit details
    Browse the repository at this point in the history

  2. Remove twitter's HDFS proxied user patch, use oss version

    @Yaliang
    Yaliang committed Oct 20, 2017
    Configuration menu
    Copy the full SHA
    076fa7f View commit details
    Browse the repository at this point in the history

  3. Use a non-default executer in impersonation test

    @Yaliang
    Yaliang committed Oct 20, 2017
    Configuration menu
    Copy the full SHA
    359c77c View commit details
    Browse the repository at this point in the history

  4. Add simple hdfs impersonation test in Travis CI

    @Yaliang
    Yaliang committed Oct 20, 2017
    Configuration menu
    Copy the full SHA
    dc17415 View commit details
    Browse the repository at this point in the history

  5. Use loginUser instead of currentUser in SimpleHadoopAuthentication

    @Yaliang
    Yaliang committed Oct 20, 2017
    Configuration menu
    Copy the full SHA
    eabf99c View commit details
    Browse the repository at this point in the history

  6. Added Parquet Structural Type Evolution Test

    @Yaliang
    Yaliang committed Oct 20, 2017
    Configuration menu
    Copy the full SHA
    2f1b889 View commit details
    Browse the repository at this point in the history

  7. Allow structural coercion in HiveCoercionPolicy

    @Yaliang
    Yaliang committed Oct 20, 2017
    Configuration menu
    Copy the full SHA
    b5f6cd7 View commit details
    Browse the repository at this point in the history

  8. Add support to coerce structural type

    @Yaliang
    Yaliang committed Oct 20, 2017
    Configuration menu
    Copy the full SHA
    e868f56 View commit details
    Browse the repository at this point in the history

  9. Update TestHiveCoercion

    @Yaliang
    Yaliang committed Oct 20, 2017
    Configuration menu
    Copy the full SHA
    6851b14 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2017

  1. Remove CLI group in singlenode-hdfs-impersonation environment product… 

    … test
    @Yaliang
    Yaliang committed Oct 21, 2017
    Configuration menu
    Copy the full SHA
    ef2caad View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2017

  1. Merge pull request twitter-forks#107 from Yaliang/yaliangw/remove-rea… 

    …d-as-proxy-user-flag

Remove twitter's HDFS proxied user patch, use oss version
    @Yaliang
    Yaliang authored Oct 24, 2017
    Configuration menu
    Copy the full SHA
    5763e4d View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#115 from Yaliang/yaliangw/twitter/th… 

    …rift-schema-evolution

Point the thrift id into NON_EXISTED_THRIFT_ID if the id resolver failed
    @Yaliang
    Yaliang authored Oct 24, 2017
    Configuration menu
    Copy the full SHA
    57be209 View commit details
    Browse the repository at this point in the history

  3. Move back to 0.186 version number to prepare upgrade

    @Yaliang
    Yaliang committed Oct 24, 2017
    Configuration menu
    Copy the full SHA
    52b1266 View commit details
    Browse the repository at this point in the history

  4. Merge oss 0.187

    @Yaliang
    Yaliang committed Oct 24, 2017
    Configuration menu
    Copy the full SHA
    cb168bb View commit details
    Browse the repository at this point in the history

  5. bump up version to 0.187-tw-0.41

    @Yaliang
    Yaliang committed Oct 24, 2017
    Configuration menu
    Copy the full SHA
    d2083d3 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2017

  1. Merge pull request twitter-forks#118 from Yaliang/yaliangw/twitter/0.… 

    …187-tw-0.41

release 0.187-tw-0.41
    @Yaliang
    Yaliang authored Oct 27, 2017
    Configuration menu
    Copy the full SHA
    dcfc6a3 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2017

  1. Fix block builder

    @Yaliang
    Yaliang committed Oct 31, 2017
    Configuration menu
    Copy the full SHA
    5232a9f View commit details
    Browse the repository at this point in the history

  2. add geospatial plugin in presto-twitter-server

    @Yaliang
    Yaliang committed Oct 31, 2017
    Configuration menu
    Copy the full SHA
    1a1474a View commit details
    Browse the repository at this point in the history

  3. Merge pull request twitter-forks#119 from Yaliang/yaliangw/hive-thrif… 

    …t-reader-fix

Fix row/map block builder for hive thrift reader
    @Yaliang
    Yaliang authored Oct 31, 2017
    Configuration menu
    Copy the full SHA
    611a7ba View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2017

  1. Merge pull request twitter-forks#120 from Yaliang/yaliangw/update-pre… 

    …sto-twitter-server-plugins

add geospatial plugin in presto-twitter-server
    @Yaliang
    Yaliang authored Nov 1, 2017
    Configuration menu
    Copy the full SHA
    51dcfed View commit details
    Browse the repository at this point in the history

  2. bump up version to 0.187-tw-0.42

    @Yaliang
    Yaliang committed Nov 1, 2017
    Configuration menu
    Copy the full SHA
    d2a9f19 View commit details
    Browse the repository at this point in the history

  3. Merge pull request twitter-forks#121 from Yaliang/yaliangw/twitter/re… 

    …lease-0.187-tw-0.42

bump up version to 0.187-tw-0.42
    @Yaliang
    Yaliang authored Nov 1, 2017
    Configuration menu
    Copy the full SHA
    aa94c25 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2017

  1. Unwrap the FileSystemWrapper to get the raw file system when checking… 

    … isHDFSCompatibleViewFileSystem
    @Yaliang
    Yaliang committed Nov 3, 2017
    Configuration menu
    Copy the full SHA
    7840b47 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2017

  1. Merge pull request twitter-forks#122 from Yaliang/yaliangw/twitter/ge… 

    …t-raw-file-system

Unwrap the FileSystemWrapper in isHDFSCompatibleViewFileSystem
    @Yaliang
    Yaliang authored Nov 6, 2017
    Configuration menu
    Copy the full SHA
    403ebd2 View commit details
    Browse the repository at this point in the history

  2. Merge pull request twitter-forks#117 from Yaliang/yaliangw/twitter/st… 

    …ructural-type-coerce

Support structural type coercion
    @Yaliang
    Yaliang authored Nov 6, 2017
    Configuration menu
    Copy the full SHA
    04be4e2 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2017

  1. Switch the version number to oss base version 0.188

    @Yaliang
    Yaliang committed Nov 7, 2017
    Configuration menu
    Copy the full SHA
    c1ed0b8 View commit details
    Browse the repository at this point in the history

  2. Merge 0.188 version

    @Yaliang
    Yaliang committed Nov 7, 2017
    Configuration menu
    Copy the full SHA
    e9305f6 View commit details
    Browse the repository at this point in the history

  3. Bump up version to 0.188-tw-0.43

    @Yaliang
    Yaliang committed Nov 7, 2017
    Configuration menu
    Copy the full SHA
    0360705 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2017

  1. Merge pull request twitter-forks#123 from Yaliang/yaliangw/twitter/re… 

    …lease-0.188-tw-0.43

release 0.188-tw-0.43
    @Yaliang
    Yaliang authored Nov 8, 2017
    Configuration menu
    Copy the full SHA
    0239495 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2017

  1. Point all missed thrift id to NON_EXISTED_THRIFT_ID

    @Yaliang
    Yaliang committed Nov 22, 2017
    Configuration menu
    Copy the full SHA
    059f41b View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2017

  1. Merge pull request twitter-forks#125 from Yaliang/yaliangw/twitter/th… 

    …rift-miss-id

Point all missed thrift id to NON_EXISTED_THRIFT_ID
    @Yaliang
    Yaliang authored Nov 29, 2017
    Configuration menu
    Copy the full SHA
    7f14bbb View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2017

  1. Add slack room notification

    @Yaliang
    Yaliang committed Dec 11, 2017
    Configuration menu
    Copy the full SHA
    900df86 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2017

  1. Merge pull request twitter-forks#127 from Yaliang/yaliangw/twitter/ad… 

    …d-slack-room

Add slack room notification
    @Yaliang
    Yaliang authored Dec 12, 2017
    Configuration menu
    Copy the full SHA
    fae47bd View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2017

  1. Handle empty structs by inserting an unknown field

    @Yaliang
    Yaliang committed Dec 13, 2017
    Configuration menu
    Copy the full SHA
    5f8c495 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2017

  1. Merge pull request twitter-forks#126 from Yaliang/yaliangw/twitter/em… 

    …pty-struct

Automatically insert an unknown type for empty structural type
    @Yaliang
    Yaliang authored Dec 19, 2017
    Configuration menu
    Copy the full SHA
    022c15f View commit details
    Browse the repository at this point in the history

  2. Add twitter functions

    @Yaliang
    Yaliang committed Dec 19, 2017
    Configuration menu
    Copy the full SHA
    9d9b6b0 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2017

  1. Merge pull request twitter-forks#128 from Yaliang/yaliangw/twitter/tw… 

    …itter-function

Add split_every function:

split_every(string) → array
Splits string on every character and returns an array.

split_every(string, length) → array
Splits string on every length characters and returns an array. length must be a positive number.

split_every(string, length, limit) → array
Splits string on every length characters and returns an array of size at most limit. The last element in the array always contains everything left in the string. limit must be a positive number.
    @Yaliang
    Yaliang authored Dec 20, 2017
    Configuration menu
    Copy the full SHA
    7f86f28 View commit details
    Browse the repository at this point in the history

  2. Change version back to 0.188

    @Yaliang
    Yaliang committed Dec 20, 2017
    Configuration menu
    Copy the full SHA
    5b4057b View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2017

  1. Merge 0.191; refactor Lzo split, refactor Metastore cluster module;

    @Yaliang
    Yaliang committed Dec 21, 2017
    Configuration menu
    Copy the full SHA
    e989b8c View commit details
    Browse the repository at this point in the history

  2. Switch to tw version tag

    @Yaliang
    Yaliang committed Dec 21, 2017
    Configuration menu
    Copy the full SHA
    66077cf View commit details
    Browse the repository at this point in the history

  3. Fix issues

    @Yaliang
    Yaliang committed Dec 21, 2017
    Configuration menu
    Copy the full SHA
    6cf45a2 View commit details
    Browse the repository at this point in the history

  4. Fix lzo index issue

    @Yaliang
    Yaliang committed Dec 21, 2017
    Configuration menu
    Copy the full SHA
    1cef2fe View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2017

  1. Improve lzo index issue

    @Yaliang
    Yaliang committed Dec 22, 2017
    Configuration menu
    Copy the full SHA
    b0402f1 View commit details
    Browse the repository at this point in the history

  2. [Release] 0.191-TW-0.44 

    OSS 0.191 Based Release, 0.191-TW-0.44
    @Yaliang
    Yaliang authored Dec 22, 2017
    Configuration menu
    Copy the full SHA
    0a2ed99 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2018

  1. Allow non-secured request authentication over pathes matching given r… 

    …egrex

This is useful when the non-secured port hosted behide a secured front-end service and direct non-secured port access has been limited by a firewall
    @Yaliang
    Yaliang committed Jan 5, 2018
    Configuration menu
    Copy the full SHA
    7aa438b View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2018

  1. Allow non-secured request authentication over paths matching given regex 

    The authentication over non-secured port is useful when the non-secured port hosted behind a secured front-end service and direct non-secured port access has been limited by the firewall
    @Yaliang
    Yaliang authored Jan 18, 2018
    Configuration menu
    Copy the full SHA
    97e6f98 View commit details
    Browse the repository at this point in the history

  2. Revert twitter version to oss version

    @Yaliang
    Yaliang committed Jan 18, 2018
    Configuration menu
    Copy the full SHA
    f738bed View commit details
    Browse the repository at this point in the history

  3. Fix conflict

    @Yaliang
    Yaliang committed Jan 18, 2018
    Configuration menu
    Copy the full SHA
    aa7e27b View commit details
    Browse the repository at this point in the history

  4. Upgrade to 0.192-tw-0.45

    @Yaliang
    Yaliang committed Jan 18, 2018
    Configuration menu
    Copy the full SHA
    df2ba31 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2018

  1. upgrade to 0.192 

    upgrade to 0.192
    @Yaliang
    Yaliang authored Jan 24, 2018
    Configuration menu
    Copy the full SHA
    ac8460d View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2018

  1. Ignore not found files

    @Yaliang
    Yaliang committed Jan 26, 2018
    Configuration menu
    Copy the full SHA
    5cf9713 View commit details
    Browse the repository at this point in the history

  2. Ignore files with invalid locations 

    Ignore not found files
    @Yaliang
    Yaliang authored Jan 26, 2018
    Configuration menu
    Copy the full SHA
    ae06968 View commit details
    Browse the repository at this point in the history

  3. Release 0.192-tw-0.46

    @Yaliang
    Yaliang committed Jan 26, 2018
    Configuration menu
    Copy the full SHA
    0c005cd View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2018

  1. Release 0.192-tw-0.46 

    Release 0.192-tw-0.46
    @Yaliang
    Yaliang authored Jan 27, 2018
    Configuration menu
    Copy the full SHA
    7887dd5 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2018

  1. Update travis notification token due to twitter slack group name chan… 

    …ge (twitter-forks#137)
    @Yaliang
    Yaliang authored Feb 13, 2018
    Configuration menu
    Copy the full SHA
    7285a68 View commit details
    Browse the repository at this point in the history

  2. Allow giving a complete service principle for Kerberos authentication (… 

    …twitter-forks#136)

The built-in host-based service name type for Kerberos authenticator cannot fit our use case. By allowing pass a specific service principle and use the user based name type, the authenticator can be authenticated by Kerberos master without specifying the host running Presto service.
    @Yaliang
    Yaliang authored Feb 13, 2018
    Configuration menu
    Copy the full SHA
    37bdeb7 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2018

  1. Use HadoopLzoDecompressor in ParquetCompressionUtils

    @luohao @Yaliang
    luohao authored and Yaliang committed Feb 16, 2018
    Configuration menu
    Copy the full SHA
    d094107 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2018

  1. Release 0.192-tw-0.47

    @luohao @Yaliang
    luohao authored and Yaliang committed Feb 20, 2018
    Configuration menu
    Copy the full SHA
    fc8c262 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2018

  1. Fix find field by name in optimized parquet reader

    @luohao @Yaliang
    luohao authored and Yaliang committed Feb 23, 2018
    Configuration menu
    Copy the full SHA
    6b7fe25 View commit details
    Browse the repository at this point in the history

  2. Release 0.192-tw-0.48 (twitter-forks#144)

    @Yaliang
    Yaliang authored Feb 23, 2018
    Configuration menu
    Copy the full SHA
    d9c32ba View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2018

  1. Add Snowflake functions 

    Add utility functions for snowflake ids (https://developer.twitter.com/en/docs/basics/twitter-ids).

is_snowflake(id) → boolean
Return if a bigint is a snowflake ID (true/false).

first_snowflake_for(timestamp) → bigint
Return the first snowflake ID given a timestamp.

timestamp_from_snowflake(id) → timestamp
Return the timestamp given a snowflake ID.

cluster_id_from_snowflake(id) → bigint
Return the cluster ID given a snowflake ID.

instance_id_from_snowflake(id) → bigint
Return the instance ID given a snowflake ID.

sequence_num_from_snowflake(id) → bigint
Return the sequence number given a snowflake ID.
    @Yaliang
    Yaliang authored Mar 21, 2018
    Configuration menu
    Copy the full SHA
    912b22d View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2018

  1. Add documents for split_every functions

    @Yaliang
    Yaliang authored Mar 23, 2018
    Configuration menu
    Copy the full SHA
    55fe33e View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2018

  1. Move version to new oss version

    @Yaliang
    Yaliang committed Mar 24, 2018
    Configuration menu
    Copy the full SHA
    8f84b9b View commit details
    Browse the repository at this point in the history

  2. Fix conflicts

    @Yaliang
    Yaliang committed Mar 24, 2018
    Configuration menu
    Copy the full SHA
    a92f26d View commit details
    Browse the repository at this point in the history

  3. Use total memory as peak memory bytes metrics

    @Yaliang
    Yaliang committed Mar 24, 2018
    Configuration menu
    Copy the full SHA
    67273de View commit details
    Browse the repository at this point in the history

  4. fix conflict

    @Yaliang
    Yaliang committed Mar 24, 2018
    Configuration menu
    Copy the full SHA
    4c6c8e0 View commit details
    Browse the repository at this point in the history

  5. Change version name

    @Yaliang
    Yaliang committed Mar 24, 2018
    Configuration menu
    Copy the full SHA
    0c35ec6 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2018

  1. Fix test failure due to twitter patch in sql

    @Yaliang
    Yaliang committed Mar 27, 2018
    Configuration menu
    Copy the full SHA
    baa68cf View commit details
    Browse the repository at this point in the history

  2. Upgrade to 0.196-tw-0.49 

    Upgrade to 0.196 based version
    @Yaliang
    Yaliang authored Mar 27, 2018
    Configuration menu
    Copy the full SHA
    62cb24c View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2018

  1. Add ldap password authenticator and local file connector to twitter s… 

    …erver (twitter-forks#149)
    @Yaliang
    Yaliang authored Apr 12, 2018
    Configuration menu
    Copy the full SHA
    e010962 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2018

  1. Roll back the version number to 0.196

    @Yaliang
    Yaliang committed Jun 4, 2018
    Configuration menu
    Copy the full SHA
    5350b8b View commit details
    Browse the repository at this point in the history

  2. Merge oss/0.203

    @Yaliang
    Yaliang committed Jun 4, 2018
    Configuration menu
    Copy the full SHA
    e50f6ac View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2018

  1. Update branched version number and fix conflicts

    @Yaliang
    Yaliang committed Jun 8, 2018
    Configuration menu
    Copy the full SHA
    489d3d2 View commit details
    Browse the repository at this point in the history

  2. Support case-insensitive parquet columns look up

    @Yaliang
    Yaliang committed Jun 8, 2018
    Configuration menu
    Copy the full SHA
    c71d5a9 View commit details
    Browse the repository at this point in the history

  3. Fix kill url

    @Yaliang
    Yaliang committed Jun 8, 2018
    Configuration menu
    Copy the full SHA
    fdfce17 View commit details
    Browse the repository at this point in the history

  4. Add --user option in cli

    @Yaliang
    Yaliang committed Jun 8, 2018
    Configuration menu
    Copy the full SHA
    67b7cfa View commit details
    Browse the repository at this point in the history

  5. Release 0.203-tw-0.50

    @Yaliang
    Yaliang authored Jun 8, 2018
    Configuration menu
    Copy the full SHA
    98b730f View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2018

  1. Update the key for the memory reservation bytes (twitter-forks#154)

    @Yaliang
    Yaliang authored Jun 14, 2018
    Configuration menu
    Copy the full SHA
    3fd1657 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2018

  1. Fix backward-compatibility processing for array with one group field (t… 

    …witter-forks#155)

According to Parquet spec:
If the repeated field is a group with one field and is named either array
or uses the LIST-annotated group's name with _tuple appended
then the repeated type is the element type and elements are required.

https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#lists

(cherry picked from commit 346f38e)
    @luohao @Yaliang
    luohao authored and Yaliang committed Jun 20, 2018
    Configuration menu
    Copy the full SHA
    0126bf1 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2018

  1. Set default soft memory limit to Long.MAX_VALUE (twitter-forks#156) 

    This fixes prestodb#10383, where deployments using the legacy resource group
configuration manager were unable to run more than a single query that
used memory concurrently.
    @Yaliang
    Yaliang authored Jun 27, 2018
    Configuration menu
    Copy the full SHA
    2166490 View commit details
    Browse the repository at this point in the history

  2. Update the key in the StageStats (twitter-forks#158)

    @Yaliang
    Yaliang authored Jun 27, 2018
    Configuration menu
    Copy the full SHA
    54a77d1 View commit details
    Browse the repository at this point in the history

  3. Release 0.203-tw-0.51

    @Yaliang
    Yaliang authored Jun 27, 2018
    Configuration menu
    Copy the full SHA
    c2428ab View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2018

  1. Fix missing fields in thriftEvent in eventlistener (twitter-forks#161)

    @luohao @Yaliang
    luohao authored and Yaliang committed Jul 13, 2018
    Configuration menu
    Copy the full SHA
    94e8639 View commit details
    Browse the repository at this point in the history

  2. Release 0.203-tw-0.52

    @Yaliang
    Yaliang authored Jul 13, 2018
    Configuration menu
    Copy the full SHA
    00fe2e5 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2018

  1. Change version number to 0.203

    @Yaliang
    Yaliang committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    0a2cf42 View commit details
    Browse the repository at this point in the history

  2. Change version number to 0.208

    @Yaliang
    Yaliang committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    b113fb5 View commit details
    Browse the repository at this point in the history

  3. Merge 0.208 release

    @Yaliang
    Yaliang committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    6c30ad6 View commit details
    Browse the repository at this point in the history

  4. Update version 0.208-tw-0.53

    @Yaliang
    Yaliang committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    8587b9c View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2018

  1. Fix name based column lookup

    @Yaliang
    Yaliang committed Aug 30, 2018
    Configuration menu
    Copy the full SHA
    17ded15 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2018

  1. Release 0.208-tw-0.53

    @Yaliang
    Yaliang authored Sep 12, 2018
    Configuration menu
    Copy the full SHA
    8db22d6 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2018

  1. Add max outstanding split size limit for thrift splits

    @Yaliang
    Yaliang committed Sep 13, 2018
    Configuration menu
    Copy the full SHA
    b79602d View commit details
    Browse the repository at this point in the history