Skip to content

Latest commit

 

History

History
265 lines (251 loc) · 6.73 KB

102.md

File metadata and controls

265 lines (251 loc) · 6.73 KB

Results of Code LLama 34B on HumanEval/102

Date: 01 September, 2023
Model: codellama-34b-instruct
Temperature: 0.2
Passing runs: 0
Total runs: 10
Success rate: 0%

Prompt

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """

The above is an incomplete Python code fragment. Return the complete and correct code with no additional text.

Correct solution

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """if x > y:
        return -1
    if y % 2 == 0:
        return y
    if x == y:
        return -1
    return y - 1

Unit tests

def check(candidate):

    # Check some simple cases
    assert candidate(12, 15) == 14
    assert candidate(13, 12) == -1
    assert candidate(33, 12354) == 12354
    assert candidate(5234, 5233) == -1
    assert candidate(6, 29) == 28
    assert candidate(27, 10) == -1

    # Check some edge cases that are easy to work out by hand.
    assert candidate(7, 7) == -1
    assert candidate(546, 546) == 546

Runs

❌ Run 1

Start time: 2023-09-01 02:47:00
Duration: 7.17s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 2

Start time: 2023-09-01 02:50:00
Duration: 7.49s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 3

Start time: 2023-09-01 02:52:56
Duration: 7.86s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 4

Start time: 2023-09-01 02:55:53
Duration: 7.37s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 5

Start time: 2023-09-01 02:58:50
Duration: 7.42s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 6

Start time: 2023-09-01 03:01:54
Duration: 7.19s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 7

Start time: 2023-09-01 03:04:55
Duration: 7.28s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 8

Start time: 2023-09-01 03:07:57
Duration: 7.77s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 9

Start time: 2023-09-01 03:10:55
Duration: 7.64s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1

❌ Run 10

Start time: 2023-09-01 03:13:54
Duration: 7.37s
Result: Fail

def choose_num(x, y):
    """This function takes two positive numbers x and y and returns the
    biggest even integer number that is in the range [x, y] inclusive. If 
    there's no such number, then the function should return -1.

    For example:
    choose_num(12, 15) = 14
    choose_num(13, 12) = -1
    """
    if x > y:
        return -1
    for i in range(x, y+1):
        if i % 2 == 0:
            return i
    return -1